Hundreds of apartments will replace the old fish market complex on one of the last undeveloped stretches of the harbour.