Castle Manor were formed by a group of Haverhill Teachers hence the original name of Teachers. The club began competing in a new midweek cricket league for Haverhill and district sides in 1970. The first 7 years were dominated by teams such as Haverhill Colts and Horseheath before in 1977 the team made their mark and won Division 1. This was not a fluke as they retained the title in 1978 and shared it with Horseheath in 1979. However this was the last time the club would reach such heights and in 1987 Castle Manor as they had become in the intervening period were relegated to Division 2. In 1991 Manor reached their lowest ebb and in 1993 it looked like the club may fold.
However in 1994 a new era began as Stephen Lanceman took over as captain assisted by Barry Underwood, together they began to rebuild the club bringing a number of new young players, to join the experience of John Grinham. The club went from strength to strength though in the early years off the field though on the field the team struggled against far more experienced sides. With the team getting more experience results improved and on 19th July 1996 the new young Manor led by cup captain Dan Webb reached the final of the Division 3 Shield. Glory was not to be as Cavendish put their young opponents to the sword, but the evening made each of the players involved hungry to prove themselves. A year later and Stephen Lanceman took the team to runners up in Division 3 and promotion to Division 2.
In 2002 Barry Underwood who had taken over from Stephen led the team consisting of top class players such as Russell Ellicott and Matt Grinham (John's son) to their highest position since 1987 as the team finished runners up in Division 2 and only a strong Haverhill 1 denied them the title and promotion. A year later and the team were relegated once more to Division 3. A year later and with Dan Webb at the helm Manor bounced back at the first attempt, although again it was as runner up. The great thing about this team was that since the Lanceman era began there were still 7 out of the eleven from the first game of 1994 still playing regularly for Castle Manor ten years later. The club however were yo-yoing and it was relegation straight away back to Division 3 followed by runners-up again though this time only the champions got promoted. The season also marked the last for Manor legend John Grinham who had been playing for them every season from the early days of the Teachers.
Andy Edwards took over the captaincy in 2007 and after a season of consolidation he put together a strong side for 2008 and hopes were high however Manor once again failed to shrug off their bridesmaid tag as longtime rivals Mill Green pipped them to the title.
2009 finally became the season we had waited 30 years for as the club went through the entire league season unbeaten to win the league title as new signing Jason Ketteridge hit the winning boundary on 15th July at nearest rivals Abington 2 to secure the league title. However we were not finished there as on 30th July we triumphed against Hundon 1 to secure a historic double as longest serving player Dan Webb took 5 wickets to win the Highpoint Shield for the man of the match. Andy Edwards (Captain), Adam Basham, Carl Bradford, Martin Buckner, Rob Dovaston, Steve Fox, Ketteridge, Stephen Lanceman, Neil Mortimer, Ben Piper, Liam Savage, Alex Talbot, Chris Thompson, Webb, Louis Willett the 15 men used in this season of seasons.