Building a Raspberry pi controlled drone without an autopilot

Hey guys, I’m embarking on my first drone project (FPV) and I need some guidance.

After doing a bit of reading up, I came across the flight controller. But in the search of a flight controller (keeping in mind that I want to use the raspi for computer vision), I think that an autopilot is just overkill for my needs and is very expensive too, and on the other hand, I couldn’t find a way to use the simple RF controlled (generic) in conjunction with the raspi.

Is there any way I could get a flight controller that connects to the raspi?

Any advice would be amazing.

(I’m using the raspi so I could program in python, and I only want my drone to fly at 5ft and stay there, nothing fancy).