While in Columbus, Georgia during the years of 1999 to 2001; under the ministry Pastor Herald Shepherd of the United Pentecostal Church. Pastor Barnswell was selected for the position of Military Outreach Director at Fort Benning Georgia.  The spirit of God move upon Pastor Barnswell heart to move to Louisville, KY to start a Home Mission Church.  Pastor Johnny and his wife Kitty with family made their move to Louisville KY. 

Pastor Barnswell spent the earlier months of 2001 under the leadership of Pastor Randy Hollis of the Believers United Pentecostal Church.  Pastor Barnswell started a daughter work in March 17, 2002 in Louisville KY.

Pastor Barnswell was sensitive to God’s voice in seeking God’s direction and purpose for his ministry, this is how the Highest Praise Apostolic Ministries finally began to take form on March 17, 2002 at the Days Inn Hotel with a small congregation of believers.

The congregation had church at this location until they out grew it, and was in search of a larger site to have service.  They moved the congregation in 2005 from the Days Inn Hotel to their new locaion in 3330 Vetter Ave, in Louisville, KY where the church is presently located.