The Middle colonies built flour mills where wheat was ground into flour, then shipped to England. Also Know, what did the middle colonies grow? Farmers in the Middle Colonies were the most prosperious of all. They grew wheat, barley, oats, rye, and corn. The Middle Colonies were often called the breadbasket because they grew so much food.