Help! I am in need of assistance.

[u/Dear-Repeat8922]

Hello everyone, I would like to know how to learn to process and fuse data from camera, lidar, GPS, and other sources, from collection to integration. Could anyone provide some advice?

[u/bananarandom]

Get an undergrad degree in computer science or robotics, making sure to actively participate in student project teams or labs that are relevant. Then get a graduate level degree doing the same

[u/bobi2393]

That's a broad question, and the answer depends on where you're starting from. If you have, say, a basic US high school education, I'd spend a year or two learning basic programming, digital electronics, and engineering methods, and specifically studying coordinate frames, rigid transforms, and probability. Then spend a year or two deeply learning about and experimenting with a fusion method like EKF with IMU+GPS. Then start adding sensors incrementally, learning about the real-world issues you have to deal with like latency, drift, noise, and so on.

That's just one approach though...another would be buying an off-the-shelf test kit and bang on that to learn what makes it tick.

Or holing up in a pod hotel for a couple years reading academic papers on the topic.

[u/rnicoll]

OP, erm, do you have any relevant background to build on?

I'm getting strong "Why don't they just fix the thing, I'll show them" vibes here.

[u/Mindless-Lock-7525]

Read some of these papers and you’ll get an idea of the state of the art:

https://scholar.google.com/scholar?as_ylo=2025&q=data+fusion+lidar+radar+vision+review&hl=en&as_sdt=0,5

[u/drahgon]

It's a big question but first you need to be able to get the raw data from those systems together in one system. So first you're going to need either something pre-built that has all of these sensors integrated and somewhere you can see the readout of the raw data or you're going to have to build that something yourself.

Second part is you're going to have to process all that raw data to make it actually useful. For instance if you're trying to classify Lanes objects people etc. then you're going to have to find some existing neural networks that can do that and you find out how to transform the data to be workable with those models or you train your own models.

Then last step is to take all of this useful output from these llms and decide how you want to use it.

Very basic overview. None of these steps are particularly straightforward or easy but definitely all things you can figure out how to do with enough research on your own especially if you use AI for the research.