The Lord-Sullivan-Haskell house at 56 Market Street is believed to have been built in 1847. Italianate detailing indicates that a major renovation was undertaken about 1870. The earliest owner to be identified is Mr. J. Lord, who owned the house by 1872. By 1884, it had been sold to John J. Sullivan. Sullivan is listed in town directories as a machinist.
Thomas Franklin Waters wrote that “Captain John Lord made his last voyage as master of the ship Miles Standish to Calcutta, sailing May 17, 1855. They were preparing for the return the following March. The ship was nearly ready for sea, passengers had sent their baggage, the Captain’s daughter, who had accompanied him, had come aboard, when Capt Lord sickened with the prevailing fever and died on April 21st, 1856. In 1847, he had built for his residence the dwelling near the depot recently owned by Mr John J. Sullivan.”

John J. Sullivan was an inventor. Among the patents he received were a button-hole sewing machine in 1883, a thread-cutting attachment for sewing machines in 1903, and an improved hydrant in 1901. Sullivan was also the librarian for the Ipswich Historical Society in the same year.
By 1916, the house was owned by George and Katherine Haskell. George Haskell was a bookkeeper. By 1924, several different families were listed as living here, indicating that it had been converted to multi-family use. His Central Street store in the Wildes Block was destroyed in the great Central Street Fire on January 14, 1894.

