Or possibly a system like Debian has for source packages where auto builders go and try to build everything and only after it passes all archs does it get accepted. You would e-mail your patch to the autobuilder and it would spit you back a log file.
excellent idea.
This all gets you around compile problems but theres still the "Does it actually work?" issue. Somehow you have to go verify those changes actually work on the boards. Especially if your end goal is to prevent bricking the hardware.
For that you probally will need some sort of maintainer for each board or group of boards.
-- Richard A. Smith