Would it be possible to have these tiny arrows (up and down? shouldn't this be only down?) scalable?
No, it is not possible. The components such as text fields and boxes are part of Java platform (Mac Look and Feel). Their designers decide the arrow size is optimal and I respect that.
Mac users expect two arrows for combo boxes. Switch to Metal and Nimbus look and feel if you don't like two arrows.