Maritime surveillance systems can be employed to increase the security of ports, airports, merchant and war ships against pirates, terrorists or any hostile vessel attacks, to avoid collisions, to control maritime traffic at ports and channels and for coastal and oil platforms defense. Cameras are one of the main sensors of these systems. They are cheap and complement other types of sensors. This book was motivated by the importance of the subject, to motivate new researches and because there are no surveys about video detection and tracking of marine vehicles or they are not widespread. It is an insignificant quantity compared with other kinds of video surveillance systems. This book presents the state of the art algorithms.