Welcome to the Atlassian developer community @RohitRavindra
Yes. Multiple users can use an OAuth 2.0 App. Each user will need to grant authorization. Your application can keep that grant as long as you hold a refresh token. Please note the expected change in behavior coming soon: