A razor clam bed is the next building you should be unlocking, it's clams while useful on their own are utilised in many mix it items.
You will probably start with two worker slots unlocked, but another will be unlocked after you level up a bit. Normal harvest time is 5 minutes.