TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Full Autopilot in GTA Using TensorFlow

486 pointsby littlemtmanabout 5 years ago

24 comments

mistymountainsabout 5 years ago
Let's all give this 12 year old kid some applause. Me water-cooling my xbox 360 (yes, and I wasn't alone in doing so) at 13 felt cool, but this is on another level.
评论 #23163022 未加载
评论 #23161367 未加载
评论 #23157088 未加载
评论 #23163121 未加载
评论 #23162727 未加载
rvzabout 5 years ago
Grand Theft AutoPilot. Now that would be a great name for this project. :)
评论 #23156045 未加载
评论 #23160027 未加载
tikejabout 5 years ago
And to me this is the essence of hacking and hacker culture, not “how do I create MVP from my idea and become an entrepreneur” or “this and that in company XYZ” mindset.<p>So glad to see people doing silly things that in fact require skill. This is why I come to hackernews.<p>Keep up great work with this wonderful attitude!
评论 #23157335 未加载
评论 #23156285 未加载
评论 #23156059 未加载
评论 #23161712 未加载
评论 #23155926 未加载
评论 #23157950 未加载
wiglabout 5 years ago
What ever happened to the OpenAI&#x2F;universe GTA sandbox? Is there any reason Rockstar shouldn’t support research using their game?
评论 #23160561 未加载
评论 #23157019 未加载
评论 #23157219 未加载
评论 #23156270 未加载
评论 #23158845 未加载
numpad0about 5 years ago
For inputs, roundabout but easiest ways I know is to either just get a Pro Micro and use the gamepad library in Arduino IDE to make it a serial-to-gamepad adapter, or use it in conjunction with a cheapest no-brand knockoff Xbox 360 controller(which are easier than genuine controllers to mod as well) and solder digital&#x2F;analog out from Arduino to digital&#x2F;analog sensing pads for the same effect.<p>The latter allows real Xbox 360 to be used(don’t go online with it, that is cheating). Xbox 360 is past EOL so I bet they can be had for cheap, steps to capture is well explained by millions of wannabe streamers, and probably less tedious to set up at the same time than a PC.
评论 #23156376 未加载
hn_throwaway_99about 5 years ago
This kid is awesome. I say that even though he&#x27;s going 25 MPH in the left lane :P
renewiltordabout 5 years ago
Great job, love it. Do commercial solutions use simulations and stuff? Sounds like a great way to bootstrap is to use some of these more realistic games to get some initial work.<p>By the way, I found this part funny:<p>&gt; <i>...if it doesn’t make sense to you think about it and try to understand it.</i><p>We had a teacher once who&#x27;d say &quot;If you don&#x27;t understand, try to understand&quot;. Haha!
评论 #23158363 未加载
nagyfabout 5 years ago
Reading the title my first thought was someone is driving a driverless car in Toronto, how cool is that. I was disappointed to see it&#x27;s about the game. (Great article though)
braunsheddabout 5 years ago
I&#x27;d love to see this done in Forza, although I&#x27;m sure that&#x27;s optimizing for the wrong kind of driving behavior (lol)<p>Amazing work!
评论 #23156658 未加载
评论 #23156072 未加载
评论 #23155878 未加载
mendelmalehabout 5 years ago
sentdex did something similar a year or two ago: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLQVvvaa0QuDeETZEOy4VdocT7TOjfSA8a" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;playlist?list=PLQVvvaa0QuDeETZEOy4Vd...</a>
评论 #23156403 未加载
Qworgabout 5 years ago
If you want to play with ML racing, AWS DeepRacer is free for May (and you can compete against NASCAR drivers).<p><a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;join-the-formula-1-deepracer-proam-special-event&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;join-the-formula-1-deeprace...</a>
CrumResearchabout 5 years ago
Howdy, I came here from <a href="http:&#x2F;&#x2F;discord.comma.ai" rel="nofollow">http:&#x2F;&#x2F;discord.comma.ai</a>. littlemtman, what related source code is available? How about more details and the code for connecting to the XBox controller interface, is it open?
评论 #23159427 未加载
jaimex2about 5 years ago
Reminds me of the the Mario Kart version someone made 3 years ago: <a href="https:&#x2F;&#x2F;github.com&#x2F;kevinhughes27&#x2F;TensorKart" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;kevinhughes27&#x2F;TensorKart</a>
serfabout 5 years ago
this is pretty cool.<p>I used a similar scheme (two computers, one with HID control over the other, and a webcam to observe) as a way to hide a simple aimbot as a proof-of-concept for getting around on-computer anti-cheats that would search through memory on popular FPSs. This was years ago on games with weak anti-cheats, anyway.<p>It worked OKish. It had to rely on computer vision to do the aiming, so it was significantly slower than examples that would rely on memory pointers or straight pixel recognition from the screen itself -- but the point was proven, the computer that was cheating looked fine as far as memory was concerned.<p>modern anti-cheats that look at things like pointer movement and player randomness would definitely flag it now-a-days, but I had fun.<p>The hardest problems were room lighting, which at the time the cheapy webcams had terrible issues with anyway, FPS, and resolution.<p>Major shortcuts had to be taken back then due to the resolution and fps mismatches between the input and output, shortcuts by which reduced the bot performance significantly, but I bet that&#x27;d be a lot easier to deal with today.<p>Now, my point : I know that a majority of the memory structs are available, documented, and deconstructed for GTA V, having written cheats for the game in the past. Maybe you can exploit that to emulate some of the functions of an IMU?<p>Lots of vehicle physics variables are fairly easily exposed. &quot;GTA V Memory Structs&quot; google search will get you started on that road, should you care to.<p>Neat project. Good luck.
评论 #23163803 未加载
savrajsinghabout 5 years ago
Great work! Now let&#x27;s drive faster than 25 mph -- it&#x27;s called Grand Theft Auto for a reason :)
评论 #23156090 未加载
jgalt212about 5 years ago
The real challenge of AI vis a vis real world problems is how to create <i>infinite</i> examples, labelled observations, etc at <i>finite</i> cost.
permalacabout 5 years ago
Can I buy stock of this company?
评论 #23158042 未加载
vereloabout 5 years ago
Can it drive a plane &#x2F; the tank on the road? How do motorbikes go? So curious.
评论 #23156184 未加载
z3t4about 5 years ago
Since this is GTA, it would be cool to add pedestrians to the mix...
评论 #23163817 未加载
tinus_hnabout 5 years ago
Wasn’t there a Twitch channel running this?
评论 #23155529 未加载
评论 #23155246 未加载
baron816about 5 years ago
How about a self riding horse for RDR?
GekkePrutserabout 5 years ago
But can it do a drive-by???
muffin24about 5 years ago
sick
bzb3about 5 years ago
My heart broke when I saw it wasn&#x27;t one of the renderware era GTA games.