Underarm bumps may be due to something as simple as an ingrown hair, but it could also be a sign of something more serious.