uclibc.mk unconditionally adds the ARM subarch config entries to the config so remove them from the defconfig.