The country singer performed ‘Amazing Grace’ at President Joe Biden’s swearing-in