To study interesting arithmetic properties of binary forms, we often need a way to order them. I will discuss some natural ways to order binary forms $F(x , y)$ with integer coefficients, especially those of degree $3$ and $4$. I will show some of my recent works as examples of the importance of understanding the invariant theory of integral binary forms in order to count these important arithmetic objects.