It will be hard but doable, Visit the museum, the old fortress and casa parlante on the same day and you can meander through the old town (and visit spiridon church) on the sameday. A car will be needed to drive to the north to visit canal d'amour then carry on the coast road to Paleo. Cant help...