The president of the Bowen Gumlu Growers Association says heavy rain in the past week has not had much of an impact on properties near the Don River.
Concerns have been raised in the past that the amount of sand and silt in the river may cause it to break its banks.
A minor flood warning was issued earlier this week but levels have since dropped.
Carl Walker says the build-up of trees and other debris poses a risk.
"The more debris you put in the river the smaller the holding capacity," he said.
"So you'll still get the same amount of volume down the river but instead of staying in the river, it's got to go over the bank.
"Unless we do something with it, and we keep saying it and I feel like 'Chicken Little', but we're going to have a problem down the track.
"I don't think anyone can actually honestly say where it's going to break. We're just praying it doesn't break where there's inhabitants of the human kind."
Mr Walker says while the river has coped with the latest rain event, it may break its banks if there is a significant event like a cyclone.
"Everything at the moment is saturated, absolutely saturated because we've had rain along the coast, continuously now pretty much all of February," he said.
"So if you've got a cyclone go through now, a lot of trees would fall over, obviously because it's wet to the max and then you start getting more erosion."
© ABC 2013
08:01 EDT A two-year-old boy has died and a girl suffered serious injuries after a tree fell on their house at The Patch in the Dandenong Ranges, east of Melbourne, as severe thunderstorms swept through Victoria last night.