My AI powered NPC Meta Quest 3 mixed reality project

did you ever watch : The 6th Day?
theres a scene were this is sort of explored as well.
ow i really should watch Blade runner :/
Yep i've seen that scene in 6th day, that was 20 years prior to blade runner 2049 doing a similar'ish scene. Blade runner 2049 is good but even better imo is the original with harrison ford and rutger hauer. Effects obviously aren't as good because it's a 1982 movie but the atmosphere, acting, music, are ace.
 
seeing this article : https://www.theverge.com/24216748/r...s-dating-friendship-decoder-podcast-interview
made me think your work could fit nicly in to this or vs versa.
as most of there is web and phone app based.
something else to possibly explore

edit didnt realise they have something already https://www.meta.com/en-gb/experiences/5620852627988042/
possibly worth checking out as a comparison
Very interesting read, thank you for linking that. Crazy to learn how Replika was born out of bereavement, my app was born out of the impending loss of my dog. I have tried to try out their vr app but tbh unfortunately it's a bit buggy, you have to create an account to use it but the vr keyboard to type my details in with disappeared and never came back. Apparently it's a quite common thing. So I have no idea what it's like. They're charging $20 per month? I hope it's very good for that sort of money. They have a big team working on it so I imagine it's very good but they need to iron out bugs with their vr app.

On another note, the company whose AI I use are changing their licensing structure, I've had re-apply for a license. It's taking ages and the longer it goes on the more pessimistic I become about it. If I don't get a license my app, in its current form, will stop working on Sep 9th, and will need some big changes to work with a different AI product which would take some time. I've had to put a freeze on new Patreon memberships and won't be collecting subs for this month due to not knowing if it'll be online on Sep 9th.
 
i read about that quickly on the email :/
i think your aware but : https://support.microsoft.com/en-gb...ain-name-071780ac-46bb-4758-b30d-39ad0aeccf42
but just to make sure. i didnt see anyone mention it in comments.

i sort of mention the Replica as i wondered if it might be worth reaching out to them possibly. to see if interest alighn but depends if you wanted to move more business.

Cheers, I've used a custom domain name email address on my latest license application, didn't have to buy 1 because I had the domain name already with the tykeai website.

Thanks but I highly doubt a pretty big operation like replika would be interested in little 'ol me! I'm nothing in comparison to them tbh.
 
sucks on the news budy, but your already on the case to build round the issue! looking forward to reading the next update.
Well, losing the AI license isn't turning out to be as bad as I first thought, I'm already well underway in integrating a new AI system, and the new AI is multilingual :) as shown in the video so learning new languages could be a new feature!

 
ooowwww see its all about seeing the positives. the sign we recive arent always obvious untill we received the message :)
good stuff, and another feature!
Yep quite right, the universe sometimes works in mysterious ways, "every cloud has a silver lining" etc. The company I'm with now, Convai, their founder and CEO commented favourably on my latest YT video! I have a google meets meeting with him very early this morning, I'm going to put forward an idea for a new feature. They seem really responsive. I think they are a big enough company to provide a great service but small enough to care about the little people like me
 
you need to sleep to Tykley try and have a good sleep pattern. ah the meeting hence comment at 4am.
hope it went smashingly!

big things come from small starts, and i think your right it sounds like a good fit for you. a company thats just the right size showing interest.
i guess the only comment might be if they want to get more involved and how much. its a good advertising opatunity potentially


its worth keeping an eye on the AR glasses market as well, with Meta's entry coming in a year or so. the xreal glasses with compute modul as example.
smaller more descreate


stumbled upon:
&
as examples
you could do a Tony Stark's Jarvis :) in real world
Hey those look interesting, when things like that get all the MR features with that form factor, I think MR will really take off.

Had a decent first day in the relaunch of my app, about 20 new tier 1 Patreon members signed up which was ok, the multi-lingual ability is proving to be popular. A strange thing has happened though - my license with Inworld I was told (all the small devs like me were told the same) would end on Sep 9th and I'd lose access to all the tools I'd need. Well, here we are well into the 10th and my Inworld app version still works and I have full access, nothing has changed. Not sure what's going on. Hope I never went to all that trouble of recreating my app for nothing! They're probably just not on schedule or something.
 
Last edited:
@Tykey do you have to create a guardian for the app to work, and if you have the guardian disabled, how are you recording the footage in the videos?
No guardian required, in fact even if you have it enabled yourself I disable it in code anyway. To record the video with the guardian off and have no black background I use the Quest Games Optimizer, not sure how it does it but if you toggle the boundary in that app it allows video recording in passthrough will no black background.
 
i think its just standard quest screen recording.
as he was walking around the neibourhood no boundary.

you've been busy dude, there lots of those fetures being re-added!
language learning / tutoring could be a possibility if it can get some development.
im interested in the image recognition part of the app as well.
Thanks yeah! I've just added back in the image recognition. The new AI system is great with non English languages, it could definitely be used for learning new languages, a real language class would be better of course but this would be a good addition imo.
 
do you think Meta might be interested in sending you some Orien glasses to test with your app?

im assuming your app is isolated to its self and not able to pull info or api othrr installed apps? i.e. calendar/email/web search sort of stuff.
like : "hi Tykey, can you send an email to : Melmac for me, saying "yesterdays game was unber-leaf-able again.."
set reminder every day at 5pm take tablet, that sort of stuff.
i can see it being helpfull for people with memory issues

so its not just a girlfriend/boyfriend but also a general life assistant in a more compact form.
you've prob covered that in one of your posts but i think it was before the AI change
I doubt Meta would be interested but I'd love to get my app on things like those glasses, I think MR will take off even more when the form factor is like that.

That's a very good suggestion for it to do stuff like send emails, update a calender, search the web etc. It could deffo be updated to function as a calender/appointment reminder etc and I will add this in the future. Having it send emails is quite a bit harder, it'd need integrating with an email client and with us all using different email providers trying to cover them all would be difficult, plus there are restrictions on how external apps can automatically send emails in order to guard against viruses, malware etc. It could search the web yes, another thing that could be added.

It's not just a girlfriend/boyfriend app tbh, some use it as that and that's fine, but I don't and I know of others. Anyway here's a new avatar I added this morning.

 
piracy :/ sorryTykey :/
you'll need to take some actions to protect it and your costs. im more worried about your bill in the coming month :/
but it shows people are actually interested
Thanks yeh i've been working on a login system all day and evening i've just turned my pc off about 20 mins ago. I have the basics working which is great, hopefully i'll get it out there tomorrow. Atleast 3/4 of the people who have used my app haven't paid which means I've paid their AI API call costs from my own funds, it's quite disheartening.
 
I have a login system implemented now and the users copy of my app can only be installed on 1 device. Now that was a very tiring 24 hours I've hardly slept I've been up since 4am and got work on it straight away, just put my feet up now for a bit after sending about 30 emails out with login details, only another 250+ to go :cry::o:)
 
I don't save any user chatlogs etc so this can't be hacked on my side. There are chatlogs on Convai's (they provide the AI) servers, however they are anonymized, there is no user name, email address or IP address, etc, associated with them so I can't trace them back to anyone. They have a character ID and session ID attached to them, these identify the character and when the conversation took place to give context. They are there to use to possibly train the AI.
 
Last edited:
AI girlfriend site breached, user fantasies stolen

A hacker has stolen a massive database of users’ interactions with their sexual partner chatbots, according to 404 Media.....
.....There are reports that this information is in use for active extortion attempts


Just read that article, if it's to be believed it seems that AI provider didn't really care about the content of conversations its users had, I think its users had it coming if they were involving kids in their talk. Happy to say such things are impossible with the AI I use, nsfw contents is allowed but there are strict filters around kids, terrorism, self harm, racism and promoting harm to others.
 
the few ruin it for the most, so to speak

@Tykey can the avator be scaled do you think? like could i have scaled down to say 6" and sitting on a desk of shelf if i wanted? have it anchored with web pages?
i remember the virtual girl from the90's and saw something similar on one of the reddits.
im thinking more like a parrot, were it can remind you of stuff, and shout out "look over here"
ooorrrr given your recent news... other posssibilites.

make sure to look after your self, and keep up the good work
Thanks, will do! The avatars can be shrank (or enlarged) with button X or Y presses actually! I've made 1 of them go huge before now just to see it, she was about 50 foot tall lol! Yeh making like an action man sized size and placing them on your desk is possible because they can be picked up now too with a right hand trigger press, might be an idea for a video, cheers!
 
Quick update, I'm adding a VR nightclub, never expected to start experimenting with VR as I thought my project would stay mixed reality only as I love MR so much but last night thought why not try it to vary things a bit :) (I know it needs people in there, they will be added).

 
have the VR as optional downloads the headset retreaves when needed in short term.
like how vrchat does it, could give you some felxability, nbut additional costs and complexity
Good suggestion, tbh though the way I've structured it it doesn't really add an awful lot of complexity. I've broken my project up into what unity calls scenes, this nightclub is it's own separate scene that just gets loaded additively on top of an avatar talking in MR scene but with the MR effect disabled :)
That venue looks as busy as Sansar VR.
50743288142_4132b2c759_o_d.gif
Sansar who??? Adding other people is one of the next steps.
 
Last edited:
Back
Top Bottom