The Castle is sited on a small isolated knoll of Leighland Slates of the Devonian series, about 390 feet (119 m) high. It consisted of a square keep, (which may have been stone, or a wooden superstructure on stone foundations) and its defences, and an outer and an inner bailey.[2] The mount is 29 feet (9 m) above the 6 feet (2 m) wide ditch which itself is 7 feet (2 m) deep. The motte has a flat top. Central area occupied by approximately square foundations 33 feet (10 m) by 33 feet (10 m) with internal divisions.[3]
Alfred of Spain is the Norman Lord of Stowey recorded in Domesday and the building of the castle is normally attributed to him or to his daughter Isabel. The earliest written reference to the castle is in a forged charter of 1154.[4]
The top of the motte was excavated by amateurs in the 19th Century but no record was made of any finds. The mounds around the top of the motte are assumed to be spoil heaps from these excavations to clear the foundations of the keep, although it has also been suggested that they may be the remains of towers.