1 Introduction

Studies indicate that geomagnetic storms during the modern era can have devastating economic and social impacts on society [1, 2]. This was first observed in 1859 when amateur astronomers Hodgson and Carrington recorded one of the largest geomagnetic storms ever known to date [3,4,5]. Widespread blackouts and failures in telegraph systems happened across Europe and North America. Since then, thousands of solar flares have been observed and recorded by a variety of different techniques across the spectrum of wavelengths. It is a matter of luck that a storm of the same magnitude has not hit Earth since then. In 2022, 40 out of 49 SpaceX Starlink satellites failed due to the aftereffects of a geomagnetic storm [6]. As satellites are vital for navigation, telecommunications and Earth Observation, the loss of critical space infrastructure directly places many typical human activities at risk. This is why in 2019 at the UN General Assembly, the UK government quadrupled its investment into Space Weather Operations at the Met Office [7].

Geomagnetic storms originating from the Sun have two constituents, solar flares and Corona Mass Ejections (CMEs). Solar flares are X-ray and other high energy emissions which travel at the speed of light. These take approximately 8 minutes to reach Earth. Since they travel at the speed of light, the first visible sign that they have occurred is when the light arrives at Earth. Solar observatories near the Sun which observe these cannot notify Earth fast enough since the notification signals also travels at the speed of light. On the other hand, CMEs are particles with mass which travel over a period of several days before reaching Earth. These are likely to cause more damage but due to their slower speed, there is also more advance notice. CMEs are normally preceded by a strong flare however, the fundamental cause of flares are not clear. Which flares will result in CMEs and which will not?

In 2001, Shibata and Magara postulated that the key physical process for producing a solar flare was due to a series of events [8]: Firstly, a magnetic field emerges from the solar interior to the solar atmosphere (flux emergence). This causes a local enhancement of electric current in the Sun’s corona (current sheet” formation). Secondly, the sudden enhancement leads to rapid dissipation of the enhanced electric current through magnetic re-connection that causes the effects associated with solar flare, shock heating and CMEs. Although solar flare theoretical modelling was developed under real observations, the details of the flaring process and CMEs are still not yet fully understood.

Traditionally, ground-based telescopes are situated at high altitudes where atmospheric effects such as absorption and wavefront aberrations are minimised. A prime example is the Gemini Observatory, consisting of twin telescopes located in Hawaii and Chile - areas known for their minimal light pollution [9]. According to [10], the total construction cost for both telescopes was $184 million [10].

Both pointing accuracy and the ability to capture enough light information are important solar telescope parameters as they are essential for obtaining high-resolution temporal and spatial observational data. The McMath-Pierce telescope, for instance, was among the largest solar telescopes at the time of its completion in 1962. Its theoretical angular resolution is reported to be 0.07 arcsec at a wavelength of 500 nm [11, 12].

Over time, telescopes have become larger and required higher pointing precision. The Daniel K. Inouye Solar Telescope (DKIST) began construction in 2013 and was completed 8 years later, in 2021. This telescope featured a 4-meter mirror but boasts a theoretical angular resolution of 0.03 arcseconds [13]. Table 1 contains an explanation of all the acronyms used in the paper.

Building large ground observatories is an expensive endeavour. The European Solar Telescope (EST), a European project aimed at constructing a next-generation 4-meter class solar telescope, will be located in the Canary Islands [14]. The design and construction of the EST are estimated to cost €150 million (approximately $171 million), with projected annual operational costs of about €6.5 million (around $7.4 million) [15].

Numerous ground-based solar telescopes are in operation around the world. For instance, the Dunn Solar Telescope, with its 0.76-meter aperture, is located in New Mexico, USA [16]. In China, the Fuxian Solar Observatory houses the 1-meter New Vacuum Solar Telescope [17]. The Teide Observatory in Tenerife is home to the 1.5-meter GREGOR telescope [18], while the 1.6-meter New Solar Telescope can be found at the Big Bear Solar Observatory in California, USA [19, 20].

However, even telescopes located at higher altitudes still face atmospheric absorption and wavefront aberrations. These factors limit observations to wavelengths above 315 nm, as the Earth’s atmosphere absorbs everything below this threshold. In an innovative move during the 1950s and 60s, the first solar telescopes were hoisted into the stratosphere using weather balloons to mitigate these issues [21]. Building on this, subsequent decades saw the launch of the first free-flying space telescopes into orbit, enabling the detection of wavelengths across the entire electromagnetic spectrum.

Table 1 Acronyms and their meanings

The Hinode space solar telescope, launched in 2006, was equipped with a 50 cm Gregorian Solar Optical Telescope. It was specifically designed to study the interactions between the Sun’s magnetic field and its corona [22]. One of its remarkable features is the image stabilisation system, which enabled a performance better than 0.01 arcsec rms, with an angular resolution of up to 0.25 arcsec.

Following this, the Parker Solar Probe was launched in 2018 with the objective of observing the Sun’s outer corona [23]. It carries the Wide-Field Imager for Solar Probe (WISPR), which includes two telescopes. These telescopes have an optical resolution of 4.2 arcmin and 5.3 arcmin, respectively [24].

The most recent milestone in solar observation came with the launch of the Solar Orbiter in February 2020. Its mission is to study the inner heliosphere and the solar wind [25]. Aboard the Solar Orbiter, the Extreme Ultraviolet Imager (EUI) is equipped with two telescopes that capture high-resolution extreme-ultraviolet images of the corona [26].

While space telescopes benefit from the absence of atmospheric distortion, this advantage must be carefully weighed against the considerable commissioning challenges they face. These include the harsh conditions of space and the complexity of design and verification processes which often result in very high costs [27]. Comparing the costs and capabilities of space and ground instruments directly might be more complex than a simple trade-off. Specifically, for certain high-performance requirements, ground-based instruments might become prohibitively expensive or even technically unfeasible due to gravitational effects warping ground-based optics. This makes space telescopes the only viable option despite their cost disadvantages. Though one advantage of ground-based telescopes are that they can be more easily maintained and upgraded, unlike telescopes up in space travelling at over 10,000 mph.

Balloon-borne telescopes combine some advantages of space and ground telescopes. These types of systems ascend to floating altitudes between 30 to 35 km, positioning them above the ozone layer. This elevated position enables them to observe a wider array of wavelengths, free from the atmospheric constraints faced by telescopes on the Earth’s surface [28, 29]. They can also be upgraded between flights and overall costs are generally much lower, making these much more accessible to a wide range of institutions and scientists.

Several projects have been using balloon platforms in the stratosphere to observe and study the Sun. The technology was pioneered by Statoscope I which was first flown in 1957 [30], the same year as when Sputnik was launched into orbit. The 12-inch balloon-borne telescope flew six times in 1957-59 with the aim of studying the turbulence and granulation in the Sun’s photosphere. The pointing accuracy of 10 arc mins was achieved.

A different instrument, flown in 1975, Spektro-Stratoskop, was a solar spectrometer with an aperture of 30 cm [31, 32]. The system weighed under one ton and was guided with an accuracy of 0.1 arcsec during an exposure time of up to 30 seconds.

The Soviet Stratospheric Observatory (SSO) was launched four times during 1966-1973, and was equipped with a 50 cm primary mirror as well as with a 1m mirror during its last flight, with the highest resolution achieved as 0.24 arc seconds [33].

More recently, the Flare Genesis Experiment flew twice in 1996 and 2000 to acquire high-resolution filtergrams and vector magnetograms of the solar photosphere and chromosphere [34]. The experiment featured an 80 cm telescope, achieving a resolution of 0.2 arcseconds, and was designed for stable pointing within a 5-arcsecond range in any direction.

The Solar Bolometric Imager was designed to provide the first bolometric maps of the solar photosphere in the range from 280 nm (ultraviolet, UV) to 2600 nm (near-infrared, NIR) [35]. It was equipped with a 30 cm telescope, achieving an angular resolution of 2.86 arcseconds, and utilise sed the same pointing platform as the Flare Genesis Experiment during its three flights in 2003, 2006, and 2007.

The Sunrise telescope, one of the largest and most powerful solar telescopes to be lifted into the Earth’s upper atmosphere, featured a 1-meter primary mirror with a Gregory-type reflector [36, 37]. This design enabled it to capture ultraviolet spectrum images of the Sun. The telescope flew twice, in 2009 and 2013. Additionally, the tracking accuracy requirement was set at \(\pm 7.5\) arcseconds RMS [38]. Beyond the telescope itself, the Sunrise mission included additional scientific instruments, such as the Sunrise Filter Imager (SuFI) and the Imaging Magnetograph eXperiment (IMaX). A third Sunrise mission is planned for launch in 2024, featuring a new gondola and updated scientific instruments [39].

Table 2 summaries key balloon-borne telescope missions and their parameters.

Finally, sounding rockets have the potential to play a crucial role in conducting solar research. During a suborbital flight, payloads are elevated above the Earth’s atmosphere, enabling the collection of high-resolution data without the distortion caused by atmospheric interference. Sounding rockets provide a lower cost and a more flexible alternative to space-based observation missions. However, when compared to balloon-borne missions, a suborbital flight via sounding rockets provides less time above the atmosphere and is more expensive. Notably, several missions have utilized sounding rockets to carry scientific instruments aimed at observing various celestial phenomena, including the study of supernova remnants [40, 41].

Despite the lower cost of balloon-borne telescopes compared to their space counterparts, these advanced balloon-borne solar telescopes remain inaccessible to most amateur astronomers and local university groups. They are too large, require huge balloons, extensive ground support teams and are consequently too expensive.

To address this, researchers such as [42] have attempted to create lower cost variants [42]. In the US, a student team from the Colorado Space Grant Consortium developed the High Elevation Light Intensity Observation System (HELIOS) that carried an Orion Maksutov-Cassegrain telescope, a Hydrogen-Alpha filter, a focus reducer, and an Image Source camera [43]. A two-stage tracking system was implemented with the coarse tracking being achieved using photodiodes and the fine tracking using solar object video identification. Unfortunately, their telescope’s focus was changed during the flight which resulted in the scientific images becoming unclear. Only a few photographs of the sun was partially captured on the left side of the images [43]. Thus, to date, to our knowledge, there is not any low-cost balloon-borne solar telescope platform that has been able to clearly capture solar images in a way that can be used for scientific research.

Table 2 Summary of balloon-borne missions and key parameters, where angular measurements are in arcseconds (“) and arcminutes (’)

This paper presents the results of the SunbYte programme. SunbYte (Sheffield University Nova Balloon Lifted Telescope) is a series of student-led projects founded in 2016. The SunbYte programme aims to acquire scientifically valuable observations of the Sun whilst inspiring and training the next generation of space engineers and scientists. The objectives are to design and develop a low-cost solar telescope capable of tracking and observing the Sun autonomously whilst surviving in the harsh environment of near space.

Such stabilised platforms could also be adapted for Earth Observation, telecommunication and wider astronomy applications. The programme involved researchers and students from the University of Sheffield across many disciplines and stages of education. This was supported by other researchers at the University of Hong Kong, the University of Hull, the University of Northumbria and Queen’s University Belfast. During the programme, the teams also established connections with several industrial partners such as Harmonic AG, a German manufacturer, developer, and designer of mechatronic drive systems/precision gears. The projects hardware was flown through the REXUS/BEXUS and HASP programme which provided transportation to the upper atmosphere.

The REXUS/BEXUS programme is realised under a bilateral Agency Agreement between the German Aerospace centre (DLR) and the Swedish National Space Agency (SNSA) [44]. The Swedish share of the payload has been made available to students from other European countries through a collaboration with the European Space Agency (ESA). EuroLaunch, a cooperation between the Esrange Space centre of Swedish Space Corporation (SSC) and the Mobile Rocket Base (MORABA) of DLR, is responsible for the campaign management and operations of the launch vehicles. Experts from DLR, ZARM, SSC and ESA provide technical support to the student teams throughout the project.

The High Altitude Student Platform (HASP) is a United States-based programme led by the Louisiana Space Consortium (LaSPACE) and supported by the National Aeronautics and Space Administration (NASA) Balloon Program Office (BPO). Each balloon flight is designed to carry up to twelve student payloads to an altitude of about 36 kilometres with a flight duration of 15 to 20 hours using zero-pressure balloons [45, 46].

SunbYte I was flown on REXUS/BEXUS in 2017, whilst SunbYte II and III were flown on NASA HASP in 2018 and 2019 respectively. The results and analysis of the SunbYte I mission are presented in a separate paper [47]. The main aim of this current paper is to present the lessons learnt through the analysis of the tracking system for SunbYte II and III. Discussions related to the other missions may also be presented to maximise benefit to the reader.

This paper is structured as follows: In Section 2, the general configuration of the three missions is described. The results of these missions are presented and analysed in Section 3. In Section 4, lessons learnt are generalised from the missions flown and evaluated to create a six-step roadmap that will allow readers to quickly configure the design of a stabilised platform for inexpensive solar high-altitude balloon-based solar observations.

2 Methodology

In order to address the educational and scientific objectives of the project, a set of requirements was created. These are based on our understanding of the science needs, the available space on the launch vehicle, as well as constraints on the cost and lead time of suppliers. Because the same launch vehicle was used in SunbYte II and III, these requirements have generally remained unchanged throughout each design iteration. On a high-level, the optics assembly required for observing the Sun must include an optical telescope, camera, and h-alpha filter setup. This filter and wavelength was selected as it is commonly used on the ground so the images taken can be compared more easily. The ADCS (Attitude Determination and Control System) is responsible for the tracking and control of the telescope, utilising motors, tracking sensors, and control feedback. This system works in conjunction with other control systems that keep the payload within its temperature limits and communicate with the ground station and personnel

2.1 General configuration

SunbYte I flew with the BEXUS platform, specifically on BEXUS-25, which allowed for flexibility in payload size and location. This flexibility enabled the use of larger motors and cameras, resulting in higher power consumption compared to later missions with HASP. The payloads were integrated into the launch vehicle uniquely depending on its individual needs and discussions with other payload teams sharing the flight. There was no standard “absolute” limit on mass, size or power, though a summary of the basic technical parameters of each of the SunbYte missions is shown in Table 3.

Table 3 A summary of the basic technical parameters of the SunbYte missions

The SunbYte I experiment had dimensions of \(910\times 730\times 1546\) mm, making it much larger when compared to later flights. This size allowed for a 203.2 mm aperture Schmidt-Cassegrain telescope. A powerful Andor Zyla sCMOS Camera was paired with this. The BEXUS platform enabled both the telescope and the accompanying tracking platform to be cantilevered from the side of the balloon gondola as shown in Fig. 1.

Fig. 1
figure 1

SunbYte I payload. The telescope and tracking platform were cantilevered from the edge of the balloon gondola for increased visibility and clearance to other objects. The flight computers which did not need to be near the tracking platform were placed inside the balloon gondola for better thermal protection

The system used two 7 W, five-phase stepper motors, each with a step angle of 0.36 deg/step. Micro-stepping was also tested and demonstrated an accuracy of 0.00288 deg/micro-step (10.368 arcsec). However, to the larger and heavier optical system, this increased torque loading and motor requirements. To meet the torque requirement, zero backlash harmonic drives (model: CPL2A HFUC - 2UH) with a 1:160 gear ratio from Harmonic Drive AG were used. This also further increasing the pointing precision to 8.1 arcsec/step [48].

To operate the scientific camera, a powerful Kaby Lake i7 7500U Mini PC with 16GB of RAM was necessary. This was used to conduct high-speed and high-resolution image capture. The demanding processing required led to some issues around thermal management, power consumption and spatial constraints [47].

For more detailed information on the flight configuration, please refer to Table 3.

Fig. 2
figure 2

SunbYte II payload. Structure made from extrusions for adjustable levels mounted using 3D printed fixtures. Perf boards are used to connect sensors together

SunbYte II flew with NASA HASP, which imposed more stringent payload constraints based on the large/small class your experiment fit into. Each large-class payload was required to conform to a maximum volume of \(380\times 300\times 300\) mm and not exceed the mass of 20 kg (in part to ensure compatibility with the thermal vacuum testing facilities). To meet these requirements, the telescope and science camera were significantly downsized with just a simple Dielectric energy rejection filter (D-ERF). This allowed the use of stepper motors with half the number of windings. A CAD model can be seen in Fig. 2. The smaller motors also facilitated a minimization of some electronic components. Despite these changes, the same harmonic drives were used as in the SunbYte I mission [47].

On HASP flights, power (2.5 amps at 30 VDC) and telecommunications are provided. A serial downlink of 4800 bps, is available using the RS232 protocol and a DB9 connector. To initiate a command uplink, the team was required to provide the HASP operator with the payload ID number and two bytes in hexadecimal format for transmission. The HASP operator will transmit commands during a limited window of time every hour.

SunbYte III was launched aboard the same HASP vehicle but with some upgrades such as the use of a Hydrogen-\(\alpha \) (\(H_{\alpha }\)) filter at 656.28 nm wavelength. The main aim of this was to help students to gain experience with the use of solar filters and to potentially obtain high-quality images of the solar chromosphere that will not be distorted by the Earth’s atmosphere.

Figure 3 shows the configuration of the SunbYte III payload, with the specific components covered in Table 3. The science camera, the ASI120MM, had a maximum resolution of \(1280 \times 960\) pixels, with a maximum readout speed of 35 frames per second (FPS). The \(H_{\alpha }\) filter was tuned for optimal performance under the anticipated flight conditions before launch. Images were recorded and stored on a 750 GB SSD. The positioning of the telescope was updated by the ‘tracking camera’, image processing tasks were handled by a Raspberry Pi (RPi) and a Teensy 3.6 microcontroller unit (MCU) was used for controlling pitch and yaw movements. The telescope was capable of pitching up to a maximum of 65 degrees, ensuring that the system could capture images of the Sun consistently throughout the flight. The yaw and pitch actuation lines are shown in Fig. 4.

Fig. 3
figure 3

SunbYte III payload. The telescope and filter are shown in the middle. The rotating structure supported the whole system with the pitch motor on the side. The onboard data handling RPi and Teensy were located below the telescope. Perf boards are now replaced with custom PCBs

Fig. 4
figure 4

Actuation line diagrams (right: Pitch, left: Yaw). The Yaw motor shaft is pointing downwards and rotates the base plate, this helps to reduce the total height of the system. The pitch motor is connected to the harmonic drive and the pitch clamp

All three designs of the telescope used similar tracking and pointing mechanisms which will be explained in the following section.

2.2 Attitude determination and control system

The objective of the Attitude Determination and Control Systems (ADCS) was to maintain the Sun within the Field of View of the telescope’s science camera and stabilise the image during the exposure time. To achieve this, the system’s tracking camera needed to identify the location of the Sun and continuously point the telescope at it.

Whilst the rotational and oscillation behaviour of NASA HASP launch vehicles (used in SunbYte II and SunbYte III) has not been published, similarities can be drawn from other launch programmes which utilise similar-sized balloons and payloads. For example, SunbYte I flew as part of the BEXUS programme. According to [49], the BEXUS manual [50], and the HEMERA manual [51]; the gondola rotates at \(\sim \)0.05 Hz with some oscillation around its centre of gravity between 0.5 Hz to 1.0 Hz with an amplitude of 0.1 degrees to 0.5 degrees. Furthermore, NASA video footage for the SunbYte II and III flight supports this information. During the ascent, the balloon can rotate up to once per several minutes (depending on the wind), but during the stabilised floating phase, this rotation reduces to once per ten to thirty minutes. This is further supported by the tracking image data during parts of the flight when the actuation of the tracking was stopped. In that scenario, the tracking camera acts as a static point on the gondola watching the sky as it rotates.

In SunbYte III, the stepper motors move at 800 rpm to provide a max 5 rpm rotation. This meets the max (yaw) rotational speed of the gondola during ascent. The rate at which the Sun moves up and down the sky over time is much less significant that the rotational performance, meaning that the speed requirements on the yaw axis will set the benchmark for the system.

The following section will detail the tracking algorithm and the hardware used for precise actuation.

2.2.1 Tracking algorithm

As the rotation of the balloon vehicle is highly dependent on the winds, SunbYte utilises a tracking system to identify the location of the Sun and point the telescope towards it.

The tracking algorithm, as a part of ADCS, was necessary to identify the location of the Sun. The system utilized a Logitech C920 tracking camera with a solar filter to obtain images at 1 FPS. Tracking was carried out in two steps. In the first phase, the pitch and yaw motors swept across the sky. Meanwhile, the image processing algorithm processed the incoming stream of images, identifying the largest and the brightest objectswhich exceed a predefined threshold value. The sweeping continued until such a object was detected. Upon detection, the algorithm transitioned to the second phase, centering the telescope on the disk of the Sun by continuously adjusting the pitch and yaw positions. The tracking algorithm used a proportional controller in both pitch (vertical) and yaw (horizontal) axes to convert the offset in pixels into stepper motor steps.

During development, other potential tracking algorithms were developed and tested. For example, an estimation of the Sun’s initial position based on magnetometer and GPS data was intended to be used as a starting point for the Sun’s position search. However, testing revealed that the stepper motors introduced significant magnetic interference with the inertial measurement unit (IMU) and this positioning method was discarded. In the future, MEMS IMU sensors could be tested as an alternative instead. This could reduce the workload compared to tracking cameras as the amount of incoming data is less.

A proposed alternative method entailed employing multiple tracking cameras alongside a fisheye camera. Nonetheless, this approach increased the computational demand as the computer had to unwrap the fisheye image for tracking, thereby complicating the tracking algorithm. Considering the gradual rotation of the balloon vehicle at float altitude, incorporating additional tracking cameras was deemed unnecessary at this developmental phase.

Furthermore, acquiring a space-qualified MOEMS sun sensor proved costly and exceeded project budget constraints. Although SunbYte II had explored light intensity sensors, they lacked the precision of camera tracking, leading to the rejection of the idea. In summary, camera tracking remains the most accurate and cost-effective method for our educational experiment.

2.3 Optics system

2.3.1 Science camera

The science camera flown on SunbYte II and III was a ZWO ASI MINI 120 mm monochromatic CMOS camera. This was powered through a 5 V USB-C connection, it is compact, low-cost, and consumes minimal power. It utilises a rolling-shutter AR0130CS sensor, providing 12bit pixel depth, a QE peak of 78%, a maximum readout speed of 35 FPS and a sensor size of is 4.8mm by 3.6mm. The stated operating temperature is between -5°C to 45°C.

2.3.2 \(H_{\alpha }\) filter

For SunbYte III, an \(H_{\alpha }\) Daystar Quark chromosphere filter was added to the telescope. The power supply was facilitated through a 5 V USB connector.

2.3.3 Mirrors

The volume constraints of the HASP platform mentioned in the section on  General configuration necessitated the use of two diagonal mirrors in order to fit within the permitted volume. Figure 5 illustrates the optical setup for SunbYte III.

Fig. 5
figure 5

Optics diagram showing telescope, science camera and mirrors

The following section will focus on the tracking results of SunbYte II and III, for more information regarding results and analysis of the SunbYte I mission, please refer to [47].

3 Results

3.1 SunbYte II

SunbYte II launched on the 4th of September 2018 at 14:03:22 UTC from Fort Sumner, New Mexico, USA. A total of 33436 pictures were taken and saved on an SD card onboard the flight computer. According to the in-flight tracking images, the tracking was successful with 3358 images containing the Sun, this corresponds to approximately 10% of images. There were 874 images where the Sun was at the calibrated centre point. No uplink commands were issued during the mission flight as it was full autonomous.

Figure 6 shows examples of the Sun images taken by the tracking camera. The red dot indicates the location of the Sun as calculated by the tracking algorithm. The yellow circle is an estimate of the Sun’s diameter.

Figure 7 is a 2D scatter plot with concentration colour bar readings of all 3358 images with the Sun presence. The x axis represents the horizontal pixel location within the tracking camera whilst the y axis represents the vertical pixel location. The calibrated centre point is at pixel position (354, 298) and red lines mark the centre lines intersecting this coordinate point. At this position, the telescope is aligned to point correctly at the Sun.

Fig. 6
figure 6

Example images of the Sun SunbYte II. The red dot is the computation Sun centre for tracking. The yellow outer circle is the tracking of the Sun’s edge

Fig. 7
figure 7

Sun concentration location SunbYte II - red box indicates the target location - where the calibrated centre is at pixel (297, 353). Paths ‘A’, ‘B’ and ‘C’ are tracking paths made by the system. ‘A’ and ‘B’ represent the successful movement of the robotic telescope towards the Sun whilst ‘C’ is only partially successful. Generated using custom MATLAB Data Density plot function [52]

There are several distinct Sun’s tracking paths moving towards the calibrated centre point. These paths describe the motion of the gimbal as it attempts to centre the Sun. As the HASP gondola is constantly rotating, it takes some time to accurately centre the image. Some of the paths indicate that the motor was not rotating fast enough to capture the Sun movement.

As the Sun will only rise to a fixed angle, a future improvement could be to discard this area from the tracking cameras images to prevent unnecessary searching, or to align the calibrated centre of the tracking camera at the top of the sensor, so that the rest of image can be used to determine the suns location.

A closeup of the centre is also shown in Fig. 7. There were more than 90 images when the Sun was in the middle of the image. One pixel below this, there are an additional 50 images. By projection, there are 9 pixels in the tracking camera which fall within the field of view of the telescope and should be considered as the “correct” location of the Sun. If we take this area into account, there are more than 400 images which locate the Sun correctly.

Due to a technical issue with the science camera system, it was not able to return any scientific images. During the final late access period, the scientific images folder was emptied to maximise space for the flight data. Unfortunately, the folder itself was also removed and thus no longer on the file path. As a result, the computer was unable to write the images to the folder as the folder no longer existed. An error prevention system that auto-creates a missing folder would have solved this problem. In addition more robust pre-flight checklist would also help prevent such problems in the future.

3.2 SunbYte III

SunbYte III launched on the 5th of September 2019 at 13:03:15 UTC from Fort Sumner, New Mexico, USA. The flight time was 7 hours and 37 minutes. A total of 387643 data points were collected based on 13367 telemetry messages from 29 different sources, including 19 sensors and various status indicators. 53726 tracking images were recorded at a rate of \(\approx 2\) FPS.

Approximately 20% of the tracking images contained the Sun. This is in contrast to SunbYte II which captured the Sun in 10% of its tracking images. Since both systems flew on missions with similar duration and used the same tracking camera with the same Field of View; initial assessment would suggest the SunbYte III system performed better. Figure 8 shows some examples of the images containing the Sun.

There were 2 uplink commands made throughout the flight in the mission: the first time was after losing power during the flight, the calibration became out of sync requiring a command to reset it. The second command lowered the speed and acceleration of the motors.

As with SunbYte II, Figure 9 shows the detected Sun locations stacked onto a single scatter plot for SunbYte III. As before, the red cross-hairs indicate the centre of the telescope within the tracking camera for calibration of the target. The point markers form many distinct curved lines in the image that show the path of the Sun during the flight time. The curvature is the path of the Sun passing through the sky as seen by the tracking camera.

The telemetry housekeeping data presented in Figs. 12, 17, 18, 15 will be used in conjunction with these tracking images to determine the behaviour and performance of the tracking system. There was a power supply interruption on the launch vehicle from T+02:12:33 until T+02:35:34 so data during this time was not collected.

Fig. 8
figure 8

Example tracking images captured with SunbYte III

Fig. 9
figure 9

2D scatter plot of Sun locations within the tracking images (Sunbyte III). Generated using custom MATLAB Data Density plot function [52]

Fig. 10
figure 10

The tracked Sun position (x and y horizontal axes) on the images taken as a function of time (vertical axis)

Fig. 11
figure 11

Tracking image from launch to T+02:31:50 (left), Tracking image from T+02:31:52 to T+02:57:23 (right)

Fig. 12
figure 12

Pitch (left) and yaw (right) motor position (in blue) with corresponding temperatures (orange)

The ambient temperature near the pitch axis is shown in red in Fig. 18. It can be used as a rough measure of when the tracking system was working effectively because of its location on the side of the payload. If there are minimal temperature fluctuations, it means the sensor is in a stationary position relative to the Sun. If it fluctuates over a period of minutes, this matches the typical oscillatory period of the balloon rotation and suggests the tracking is not working effectively.

Figure 10 is a 3D scatter plot with time as the vertical z axis. This enables the temporal and spatial distribution of the sun locations to be displayed simultaneously. To compare with Fig. 9, the equivalent 2D scatter plot would be a top view looking down onto the x and y axis. Taking different horizontal slices of time this Figure, the behaviour of the tracking throughout various periods of the flight can be dissected for closer analysis.

At the early stage of the launch in Fig. 11 (left), the Sun’s location within the tracking image was largely concentrated around the calibrated centre point at pixel coordinates (150, 110). This indicates the experiment was tracking correctly and the few points not in the centre were taken as the tracking was moving towards the centre point. It can be seen that in this time period, both the yaw and pitch were functioning as expected.

Fig. 13
figure 13

SunbYte III tracking from between times; T+02:57:23 to T+03:01:16 (left) and T+03:01:16 to T+03:06:13 (right)

Next, Figure 11 (right) contains several curved paths showing the Sun moving steadily across the tracking camera captured at regular intervals as the gondola rotates. This was because the response became slow so the system was manually powered off for the remainder of the ascent. It is likely the motor or gearing was affected by the low temperatures and this is supported by the yaw position sensor shown in Fig. 12. The flight profile takes the payload through a region of cold air and causes a significant increase in the torque required for the motors to move. Float started at approximately 15:40:37 UTC, 2 hours and 37 minutes into the flight. As the float phase began, the system resumed as planned, sweeping successfully multiple times, and then tracking the Sun.

In Figure 13 (left), the Sun location slowly moved upwards with some zigzag pattern. It represents some motion in the yaw and pitch direction. The density of the points (located close to each other), suggests that some tracking was taking place. However, the movement is not significant enough to confirm since the tracking should place the Sun at the calibrated centre of the image (the red cross-hair).

In Figure 13 (right), the telescope attempted to correct the yaw and pitch position. The telescope moved the Sun from pixel position (100, 230) to (150, 170). The yaw position is located in the correct place (150 pixels on the X-axis).

Fig. 14
figure 14

SunbYte III tracking image from between times; T+03:06:13 and T+04:27:57 (left) and T+04:27:57 to T+07:19:38 (right)

Fig. 15
figure 15

SunbYte III tracking image from time T+04:27:57 to T+07:19:38 (left). Heater Status of 4 heaters, 2 in pitch and 2 in yaw. Red dashed lines are the temperature set points for the thermal control (right)

Figure 14 shows the Sun entering the image at pixel position (0, 130) on the far left of the image (see path 1). It then moves towards the left in a distinct pattern of sporadic nature. The curves with sporadic points followed by a distinct cluster of points (e.g. pixel position (130, 180)) indicate the yaw tracking system was working successfully and pointed at the same position over a period of time (see paths 2 and 4 on the same image). The curves with a consistent density of points such as those in path 3 of Fig. 14 suggest no tracking.

Based on the video footage, the gondola changed the direction of yaw rotation several times throughout the flight. This is reflected in the zigzag pattern in some of the figures; for example, the right-hand side of Fig. 14.

At some points during the flight, the view of the Sun is blocked by other devices installed on the balloon gondola. This can be observed on the tracking images as a gap in the Sun position (see Figs. 11 (right) and 15 (left)). Figure 16 (left) shows a snapshot of the video footage when this occurs whilst Fig. 16 (right) illustrates this obstruction from the telescope’s point of view.

Fig. 16
figure 16

Image of the Sun being blocked by a payload of another experiment (left). CAD illustration from the point of view of the telescope (right)

Fig. 17
figure 17

Voltage fluctuation, current readings and power readings from time T+0hr to T+6hr

Figure 17 shows current, voltage fluctuation and power data from the current sensors located on the 12 V, 5 V and 3.3 V lines, alongside the RPi power input. The current and voltage fluctuate during the flight due to high power components being switched on and off (for example, the motors). A moving mean with a window of 200 samples is used to show overall trends. The current, voltage and power readings are within nominal range. Larger fluctuations are present on the 12 V line as it provides power to the motors. This demonstrates how the power draw of the motors changes when movement is required.

Fig. 18
figure 18

Temperature readings of different regions from T+0hr to T+7hr. The red line indicates the ambient temperature on the pitch axis

Figure 15 (right) indicates the operation of 4 on-board heaters. The primary heater is programmed to turn on below 40 degrees Celsius whilst the secondary heater is programmed to turn on below 20 degrees Celsius. More heating was required on the yaw motor than the pitch motor. The secondary heaters for the pitch motor were barely used. The second yaw heater was on in the early phases of the flight as the temperature dropped (see Fig. 18). This demonstrated SunbYte III heating system was operating as designed. The slowdown in the performance of the tracking appears to be due to cold temperatures in the harmonic drive gears causing a mechanical seizure. As the flight environment is a near vacuum, only radiation and conduction heat transfer can be used. Therefore, a future improvement could be to prioritise additional space for insulation around the harmonic drives and apply heaters directly to them. Careful attention should also be paid to any heat bridges.

There was a power loss in the HASP system between T+02:30 Hr to T+02:45 Hr, this affected the payload with the system unable to record and downlink data. In the future, on-board backup power could be implemented to ensure the data can continue to be written to the local on-board backup storage. This would require qualification and acceptance with the launch providers.

SunbYte III has partially fulfilled the experiment requirements. The active heating system was an improvement compared to SunbYte II. The tracking system was able to identify, locate and point the telescope at the Sun for a minimal period. During power loss, the payload loses active heating, more insulation could have been used to maintain the payload temperature. Due to this, the calibration point was lost. This meant the tracking centre target was no longer aligned towards the center of the sun and the pointing system no longer knew where it was relative to the yaw limits. This suggested that a fixed calibrated centre might be a better choice. In SunbYte II the calibrated centre is saved inside the code, and is supplemented with the use of physical limit switches. Both SunbYte II and III could benefit from more robust thermal systems, as conditions during the flight can become quite harsh.

3.3 Overall system discussion

The essential lesson from both SunbYte II and III underscores the significance of maintaining simplicity within systems. There are more pictures by SunbYte III compared to SunbYte II (53,726 vs 33,436 pictures). SunbYte II has approximately 10 % of the tracking images with the Sun whilst SunbYte III has approximately 20 % of the tracking images containing the Sun.

While an increase in recorded data may suggest improved functionality, it does not necessarily indicate successful sun tracking. Despite recording less data, SunbYte 2 has effectively demonstrated three distinct tracking paths (A, B, and C) both are leading to the calibrated centre, as depicted in Fig 7.

By contrast, the scatter plot of SunbYte 3 in Fig. 9 does not reveal any clear tracking path. Further examination in Fig. 10 with spatial analysis also lacks consistent evidence of the system guiding the sun toward the calibrated centre or any specific points (one except being in Fig. 11 (right)).

From this comparison, it can be concluded that SunbYte II boasts a superior overall system design. Despite being slower to respond, recording less data, and without a heating system, it fulfils the fundamental requirement of stabilisation, i.e., guiding the sun to the centre point as long as possible. SunbYte III’s hardware improvements over SunbYte II are commendable, but the system falls short of meeting the basic requirement. This deficiency may stem from three primary reasons:

Firstly, the calibration point appears to be variable, possibly adjusted during flight. This oversight is critical since the calibrated centre serves as the offset between the physical positions of the tracking camera and the telescope. This distance remains constant and must be calibrated and fixed beforehand. Failure to re-calibrate the system resulted in tracking errors, impeding its ability to follow the sun accurately.

Secondly, SunbYte II features four limiting switches at the ends of each side of the pitch and yaw motors. This provides active feedback preventing the system from ever moving beyond acceptable limits. This is vital to prevent cable entanglement and ensures that even in the event of a power loss, the resumption of power will not lead to skipped step counting. Conversely, SunbYte III lacks such a design feature. This disparity proves to be a significant difference between the two missions. Post-flight assessments emphasise the necessity of having limiting switches or similar systems to establish precise motor positions for effective tracking. Without reference points for the motors, the tracking system faces challenges, leading to erratic patterns like those seen in the Sunbyte III mission.

The hallmark of successful tracking lies in maintaining the sun at the calibrated centre for as long as possible. SunbYte II demonstrates numerous successful attempts at this, whereas SunbYte III exhibits behaviour indicative of losing control.

The third lesson learned is the importance of full autonomy. SunbYte II operates autonomously without requiring ground control or input, unlike SunbYte III, where attempts were made to correct calibration discrepancies and adjust speed and accelerations through manual uplink commands. This reliance on human intervention poses risks, as demonstrated by calibration issues and power loss affecting system stability. It is suggested that designing a more autonomous system reduces dependency on human intervention and ensures consistent system performance.

In short, the calibration point must remain fixed overall in flight duration, a mechanism should exist to track the motor’s location at some point in flight, and the system should strive for full autonomy. SunbYte II has outstanding tracking algorithms and SunbYte III has a better hardware system. The key lesson from both SunbYte II and III highlights the criticality of simplicity in system design.

4 Proposed design framework

This section uses the lessons learnt from the SunbYte program to establish a framework for developing an initial design of a low-cost solar telescope tracking system. It is intended to be a guide for readers on how to create initial design specifications. Since improving one aspect of a system’s design (e.g. higher resolution science camera), can negatively impact several other design parameters e.g. power consumption, computing requirements), it is important to have a clear design flow. A flow chart illustrating the recommended optimal design process for a typical low-cost solar telescope tracking platform is shown in Fig. 24. Firstly we shall select the science image requirement and the telescope sizes. Based on the telescope’s field-of-view, we can select the tracking camera and actuation system. Finally, the wider supporting system can be specified based on these driving requirements.

4.1 Resolution requirements

The first step in assessing the required resolution is to identify the size of the features and wavelength of light chosen for observation. For example, to resolve the solar features with the size, f of 1000 km and by taking into account the distance, l between the Earth and Sun (149.84 million km), the minimum angular resolution, \(\theta \) can be calculated using (1).

$$\begin{aligned} \theta =\arctan \left( \frac{f}{ L}\right) = 6.610\times 10^{-6} \text { deg (1.36 arcsec).} \end{aligned}$$
(1)

Figure 19 shows solar images with different filters. For example, the wavelength of \(H{\alpha }\) in a vacuum is 656.461 nm. Note, that this differs from the wavelength of \(H{\alpha }\) in the air which is 656.281 nm.

It is possible to estimate the minimum telescope aperture needed using the Rayleigh criterion

$$\begin{aligned} D=1.22\frac{\lambda }{\theta } \nonumber \end{aligned}$$

with the angular resolution in radians, \(\theta \) = \(6.593 \times 10^{-6}\) rad and wavelength being measured, \(\lambda \) = 656.461 nm. Using these two variables, the minimum diameter of the telescope lens aperture, D is 121 mm.

4.2 Determining tracking accuracy requirements

The size of the solar disk within the telescope’s field of view greatly affects the pointing requirements (see Fig. 20). For an initial design, it is recommended to image the whole disk as this greatly reduces the required tracking accuracy. Providing a larger margin of error in case of poor tracking performance or misalignment. In Figure 20, the angular resolution of the Sun is 32’. To be able to capture the Sun confidently using a four-factor margin of error, a horizontal resolution of 128’ is necessary.

Fig. 19
figure 19

The Sun in different wavelengths. Visible light (left), Ca-K at 393.4 nm (center), \(H{\alpha }\) at 656.281 nm (right) [53]

The same stabilisation system should be used throughout the integration and flight time, to make sure the system remains unchanged.

Fig. 20
figure 20

Example of a science image. The total angular resolution of the image is 128 arcmin. The middle white circle represents the Sun across a width of 32 arcmin. The left and right area represents 48 arcmin

This means the telescope and the tracking system can move up to 48 arcmin either way in the horizontal direction before the Sun begins to disappear from the edge of the image. As a result, the system’s tracking accuracy could be as low as ± 48 arcmin.

The two-stage tracking cycle consists of a sweep phase when the Sun is not in the field of view of the tracking camera; and a tracking phase when the Sun is within the field of view of the tracking camera. Three main steps as shown in Fig. 21.

  1. 1.

    The tracking camera takes images.

  2. 2.

    Those images are sent to the computer for Sun tracking calculation. If no Sun is found, it defaults to a sweeping mode to move the camera in a systematic pattern until the Sun can be found.

  3. 3.

    When the Sun is found, the offset will be calculated and sent to the motor drivers to move the telescope.

Fig. 21
figure 21

Tracking Algorithm flow diagram

Each of these procedures has its own timing and they will affect the overall tracking accuracy and latency of the system. Hence, there is a trade-off between the computer’s physical size, speed and thermal output, and also between the processing speed and accuracy of the tracking mechanism.

The motor is required to operate at sufficient speed to chase the Sun. However, if it outperforms the computer processing speed, it is a waste of performance and if it is too slow, it becomes a bottleneck of the system. A demonstration of the types of images obtained during tracking can be seen in Fig. 22. These factors define the total response time for the entire sensing and correction tracking cycle.

During the tracking process, the Baader solar filter filters out 99% of the light, meaning the remaining light must come from very bright objects (i.e, the Sun). SunbYte uses an OpenCV function - “Hough Circle Transform” to further check that the bright object is circular. It then calculates the pixel differences between the centre of the circle to the calibrated centre of the system.

Fig. 22
figure 22

Image Processing Algorithm sequence used for solar tracking: 1) Raw tracking image is taken. 2) The image is processed using filters to remove anomalies. 3) The offset calculation is carried out

4.3 Selecting on-board flight computers

The system has to be able to handle the speed of writing the images to a local storage drive as well as operate the tracking algorithm. Some extra margin is recommended to enable the computer(s) to do additional tasks such as data compression and communication with the ground or other flight systems.

It is difficult to estimate the performance of a computer without real-life testing, especially as it depends on the exact tracking algorithm implementation, available computational resources, camera resolution and environmental conditions (such as heat dissipation). A comparison to other missions and projects with similar imaging requirements can be conducted to identify analogies. For example, a Raspberry Pi computer was used for the Pan-Tilt HAT project’s tracking system with TensorFlow for computer vision [54]. Out of the box, it was benchmarked to operate at 8 FPS. A USB Accelerator containing an Edge TPU was then added which further increased the frame rate up to 24 FPS. On another project using OpenCV for deep learning object detection, Python’s multiprocessing module along with a Raspberry Pi camera achieved an FPS of 27.83 [55].

Most of these examples demonstrate that the Commercial-Off-The-Shelf (COTS) processors operate typical cameras up to 30 FPS. In the previous example, multiple objects were being tracked, hence solar tracking should be considered computationally easier than object tracking so Raspberry Pi should be a suitable computer if the camera resolution is not excessively high (above \(720\times 1280\)). There are also many online resources on utilising Raspberry Pi as an image-tracking processor which makes it a great choice for students and citizen scientists who may benefit from enhanced community support [56]. The focus for the development of the tracking system should therefore be the frequency of updates the motor drivers can receive to correct the telescope pointing position.

4.4 Selecting actuation components

4.4.1 Angular resolution requirements

As a guide, based on the resolution of the science camera being 128 arcmin, the authors suggest the pointing system must be able to have a per step angular resolution of around 10 arcmin to get the telescope pointing in a position that enables the Sunlight to enter the science camera. From this requirement alone, it will be very difficult for any motor to achieve this kind of precision without some type of gear.

The challenge with gears is that backlash reduces pointing tolerances. Harmonic drives provide a low-backlash solution. A 1:100 gear ratio with a 10 arcmin output results in the input stepper motor shaft only needing a angular resolution of 1000 arcmin, or 17 deg. This significantly eases the requirements for motor selection.

4.4.2 Torque requirements

The motor and gear must be powerful enough to move the telescope assembly in both the pitch and yaw directions. Whilst the pitch axis is more likely to encounter eccentric loads, depending on the design, the yaw axis may need to rotate more components as well as the pitch actuation mechanism. Therefore, it is worth carefully designing the system in a way that enables identical motors and gears to be used and minimises part variety. The motor needs to overcome friction as well as the static moment of inertia before it can move the telescope assembly.

4.4.3 Pitch requirements

Figure 23 shows an example of an under-slung telescope system. Since gravity acts vertically, the moment acting on the pivot is the weight of the system multiplied by the horizontal distance between the centre of mass and the pivot. At a resting neutral position, the telescope will naturally point upwards at a positive angle due to the rear of the telescope assembly being heavier. This coincidentally also minimises the power necessary to pitch the telescope up. Depending on the availability of space and other limitations, the position of the centre of mass can be optimised to minimise the pitch necessary and reduce the torque requirements (e.g. without power, the telescope could point at 30 degrees up).

Since gravity acts vertically, the pitch angle which causes maximum torque is when the centre of mass is furthest away from the pivot as shown in the last diagram.

Fig. 23
figure 23

Torque diagrams of the telescope. An under-slung system exists when mass is below the fulcrum. At rest, the centre of mass lies below the fulcrum. Maximum torsional loads occur if \(d=r\). The rear of the telescope points to the left side, and the rectangle on top represents the camera

For systems where the centre of mass lies above the fulcrum, the position of maximum torque will be when the centre of mass forms a horizontal line with the fulcrum. This is only likely to occur when the Sun is at the highest point in the sky. If it is suitable an under-slung system is recommended as it will reduce the pointing power requirements as it is inherently more stable.

The torque, T exerted on the actuation shaft can be calculated as:

$$\begin{aligned} T = mgd, \nonumber \end{aligned}$$

where m is the mass in kg, d is the horizontal distance between the fulcrum in metres and g is the acceleration due to gravity (9.81 m/s2). d can be calculated using simple trigonometry if the radial distance, r between the centre of mass and the fulcrum is known.

Table 4 Preliminary mass and power budget breakdown

4.4.4 Yaw requirements

Designing for the yaw is normally easier as the motor rotation is perpendicular to gravity so the motor does not need to fight gravitational force. The motor only needs to overcome the moment of inertia.

The presence of the gearing ratio means very little torque is usually required from the motor to actuate the system. The pitch is normally the axis that requires the most torque, using the same motor and gearing for both axes will ensure the yaw actuation can operate successfully.

4.4.5 Rotational speed requirement

The gondola, attached to the balloon, can have a yaw rotation of up to \(\phi \) times per minute, this becomes the worst possible operating case and becomes the minimum speed required for the tracking system. This speed must account for the time to point, determined by the motor setup, and the time to find, which is the time taken for an image to be captured, tracking information identified from that image and sent to the motor controllers for movement. As balloon movement is continuous, the tracking system must update frequently enough to ensure that the view of the telescope is over the sun. The size of these adjustments will influence the minimum shutter speed of the scientific camera, with smaller adjustments permitting slower shutter speeds.

If the gondolas rotation is \(\phi \), in rotations per minute, the rotation, \(\omega \) in degrees per seconds, can be calculated by \(\omega = \phi /6\). As the motors drive the yaw and pitch of the gondola through harmonic drives, the actual motor speed \(\zeta \) can be determined by the Gear Ratio (GR) and the minimum speed of tracking \(\omega \).

$$\begin{aligned} \zeta = GR * (\phi /6) \end{aligned}$$
(2)

Assuming that there was 1 full rotation of the gondola per minute with a gear ratio of 1:100, then the motors driving the yaw would need to have a minimum top speed of 600 degrees per second or 100 rpm.

Fig. 24
figure 24

System iterations and design requirements flow chart. The extra text is not very useful

4.5 Systems budget and specification

Knowing all of the scientific parameters and converting them into physical engineering specifications means that the electrical, optical and mechanical components for the project can be chosen to fulfil the mass and power budget provided. Table 4 demonstrates the variety of mass and power parameters that can be found among the different subsystems.

The 20% mass margin includes many staple components, including bolts, wiring and other miscellaneous sensors. An initial power margin of 20% was also included for the potential power draw from components operating in cold conditions, as well as from other critical systems, such as focusing, and non-critical systems, such as housekeeping sensors.

5 Conclusions

A flow chart illustrating the recommended optimal design process for a typical low-cost solar telescope tracking platform is shown in Fig. 24. During the project life, if new requirements are imposed or where the budget increases or decreases, changes to the design should always start again following the beginning of the design flow shown in Fig. 24. This will ensure the system does not become unbalanced, as improving one subsystem, such as a larger aperture telescope, may impact the technical requirements of other subsystems, requiring motors with more torque and electrical power to move it. Such an ability to quickly achieve an optimal design using the least resources available will be invaluable to educational institutions and companies looking to develop low-cost entry-level solar tracking platforms for education, research and commercial purposes.

6 Recent developments

SunbYte IV has been flown with the HEMERA program (funded by the Horizon 2020 [57]), the new payload volume allowed for a larger Williams Optics GT-71 II 2019 to be fitted and the refracting prisms removed, reducing the number of potential optical artefacts [58]. Additionally, the science camera was upgraded to a ZWO ASI183MM, which as well as supporting a higher resolution of 20.18 megapixels, and an improved readout speed of 19 FPS; also has improved quantum efficiency of \(84\%\) in the \(H\alpha \) channel and a better read noise of 1.6e. The system underwent a new design cycle following the guidelines presented in Section 4. Some highlights include replacing the Raspberry Pi with a more powerful Single Board Computer (SBC), the Odroid M1. This tracked the sun and saved the images taken by the science camera. The Teensy MCU was replaced with an Ethernet-capable Arduino which interpreted UDP packets to drive the Pitch and Yaw motors. The onboard software was also completely rewritten in C++ to further improve processing speed. Future work will analyse the data generated from this later flight and evaluate the impact of the upgrades on the tracking performance and scientific output.