On Tuesday, workers demolished what remained of a downtown Jeffersonville office building that burned in a December fire.