I have removed my base walls and cannot rebuild them.

Your walls are not lost. You can replace them again in your base after entering the wall mode.

You can find the wall mode after tapping on your Command Ship. In the Command Ship menu, tap on Wall Mode. You can then edit and build your walls again.