From Bark to Bot – Making of a Robotic Shepherd

This summer, AgriFoRwArdS organized a unique collaboration that brought together six interdisciplinary teams with a shared mission: to explore and develop an autonomous robotic shepherding system. Over an intensive week, participants combined expertise in robotics, AI, communication systems, drone technology, ethics, and economics to sow seeds towards building a functioning prototype that could someday revolutionize livestock herding.

The effort began with the development of robust communication protocols. Team “Baa-ndwidth” focused on implementing wireless schemes such as LoRa and ESP_NOW to establish reliable data links between control systems and mobile robotic agents. These protocols were tested through heat maps charting their performance across various environments, ensuring the systems could maintain strong connections at different distances. The protocols enabled real-time command transmission using ROS2 messages, forming the backbone for coordinated robotic behaviour.

Simultaneously, team “ShLAMb” tackled the challenge of detecting and tracking sheep from the air. Using drone footage captured under a range of conditions—including different altitudes, lighting, and natural occlusions—they developed a sophisticated computer vision pipeline. To enhance detection in low-light areas, they applied the Retinex algorithm and trained a custom YOLO11n model for accurate sheep recognition. Real-time tracking was enabled through ByteTrack, with early progress made toward converting video pixel data into GPS coordinates, a key requirement for practical field deployment.

Understanding sheep behaviour was another critical component. Team “ShepSim” dedicated to behavioural modeling created simulations that mimicked natural flocking behavior, allowing them to predict and influence sheep movement. By integrating these simulations into the ROS2 ecosystem, they could test control strategies and refine their system using real-time data from other groups. This artificial life model enabled the robotic system to anticipate sheep responses and plan movements accordingly.

Supporting these efforts from above, team “Baa Force One” responsible for managing the drone’s video feed and metadata. They encountered early challenges with software compatibility but quickly adapted, streaming footage via RTMP and publishing it through a ROS2 node with only a minimal delay. To compensate for the lack of built-in GPS data, they improvised by attaching a GPS-enabled ESP8266 module to the drone. They also calculated the camera’s intrinsic matrix to provide accurate field-of-view information. These solutions ensured a reliable and synchronized flow of aerial data for the broader system.

On the ground, team “Walkies” worked hands-on with the robot dogs themselves. Starting with the unboxing and configuration of a Unitree Go2 Edu, affectionately named Doug, they also integrated RTK GPS sensors with a Boston Dynamics SPOT robot. As the week progressed, they advanced from manual control to autonomous waypoint navigation. By the end of the program, they had successfully integrated their system with the wireless protocols developed earlier, allowing for remote control of the robotic dog—a significant milestone in the project.

While technical progress surged ahead, team “Flockonomics” explored the societal dimensions of robotic shepherding. Divided into sub-teams, they conducted interviews with animal behaviour experts, sheep farmers, and agri-tech professionals, gathering insights into the ethical considerations of replacing human and canine shepherds with robots. In parallel, they conducted a market study and literature review to assess the economic feasibility of deploying such systems in real-world agricultural contexts. Their findings, rich in both qualitative and analytical perspectives, are being prepared for publication to contribute to ongoing debates in AI and society.

Together, the six teams laid the groundwork for a future autonomous robotic shepherding system, blending early-stage engineering with thoughtful consideration of its broader implications. While still in its preliminary stages, the project showcased the potential of interdisciplinary collaboration to tackle complex, real-world challenges and opened promising avenues for continued research and development.

Social activities

Students also enjoyed two exciting social events designed to build connections and create lasting memories outside the classroom.

On Tuesday evening, the group gathered for a social dinner at ASK Italian, where students had the chance to relax, share stories, and enjoy a meal together in a friendly and casual setting. The atmosphere was lively, and the event offered a perfect opportunity for students to unwind and strengthen their community bonds.

Thursday brought a choice of adrenaline-pumping activities—axe throwing or go-karting. Whether testing their precision with a throwing axe or racing friends around the track, students embraced the spirit of fun and friendly competition. Laughter, cheers, and a little healthy rivalry filled the evening.

Presentations and awards

The Summer School wrapped up on a high note as the six groups presented their final findings after a week of learning, collaboration, and hands-on research. Each group tackled a unique topic, applying the skills and knowledge they gained throughout the week to deliver insightful and creative presentations.

While all six groups impressed with their hard work and professionalism, one stood out for its exceptional teamwork, originality, and polished delivery.

The Organising Team discussed a number of merits and criteria for each team, and decided Group 5 (ShepSimulation) were to be awarded the Summer School Award for their outstanding work! Their project combined analytical rigor with a compelling narrative, earning praise from both the judges and the audience.

A huge congratulations to all the students for their efforts—you made this Summer School unforgettable!

Thank you to the organisation team

We would like to thank those who were part of the incredible organising team, whose hard work and dedication made this event such a success. From the early planning stages to the final moments, every detail was thoughtfully considered and flawlessly executed.