A Raspberry Pi rover is best when the Pi handles vision and networking while a microcontroller handles motors and safety. This split prevents Linux pauses from turning into runaway motion.
The power system is the make-or-break part. Use one battery pack with proper buck converters, fusing and a hard motor disable path.