Children's book from many years ago

Trying to find this book about some children who see a ship that is docked that has some beautiful birds on the deck. The children are enthralled and board the ship to get a better look. They are kidnapped and taken to an island where they are forced to gather chalk for their captors. Trying to find book name/author. Thanks

Jexium Island by Madeleine Grattan?