The historic First Baptist Church was founded in November 1843, with its origins connected to a woman named Mary Craven who traveled from New Jersey to New Castle and helped organize the Baptist congregation. The early congregation met in various locations, including an old Methodist Church, until a small church building was constructed on North Street in 1848. A larger church, shown here, was built in 1890 at the southwest corner of North and East Streets, featuring main entrances on both streets and adorned with intricate stained glass windows.