That's not a bad choice of bait considering the grunion run that's "supposed" to be occuring. Might try and different stretch of sand, but yes, you will more than likely have to contend with the flatfish of the wrong kind.
Good luck out there...
Don
I think the smelt works better off a jetty than a beach.