Do I need to setup product weights and dimensions?

Short answer - yes, you must!

Australia Post rates are weight-based rates so for the app to quote rates successfully, you will need to make sure you have applied weights to all of your products.

Setting up products with dimensions is also vital. By recording product dimensions, Addition will calculate the most efficient packaging for a particular order (the total items in the cart) and offer the customer a more accurate shipping rate.