Yes,It's will work.
Before put your AT&T sim card,Make sure your T-mobile Samsung Galaxy Note 2 phone is unlocked.If it's restricted means,you will need to unlock your phone.For unlocking you can approach your service provider or else try to buy an unlocking service from any one of the online unlocking service provider like Prounlocking.com Here you can unlock your phone at low cost.Once unlock your phone,you will be able to swap network carrier when you need.