Make it really easy on yourself and purchase lanterns at the dollar store!
My colleague cut out all sorts of ocean creatures from colorful tissue paper.
We then watered down some regular white elemers school glue and then helped the children paste on their selections.
Here's the end result! I think they will look amazing lit at night.