The multiple uses of the new Doc AI cam
The new DOC AI cam can be used for more than just predator monitoring. It has been designed as a flexible tool to allow a large range of conservation uses. Below is a list of the features that make it a bit different, followed by a list of conservation tasks the DOC AI camera can be used for.
Below is a list of features either already available or that we are working on:
Thermal camera - this is 3-20 times more sensitive than typical trail cameras so you can understand much better what is happening in your environment.
Flexible easy data connectivity - no SD cards needed. The data is uploaded by WI-FI, cell or to an app on your phone that is then synced to the cloud. Data is always recorded and uploaded with accurate date, time, GPS etc. The data is always available in the cloud and automatically backed up. This reduces workload and automates an arduous task.
Link to AI analysis platform - not only can the device see many more predators but you automatically get a report about how many predators of different types you have at each location and how it changes over time. No need to manually look through footage though you can check any predator visits of interest. This saves hours of work and an email summary just appears in your inbox. The AI identifies all the normal predators as well as many more like kiwi, penguins, deer, wallabies etc.
Link to notification system - the system can be set up to send you email notifications in real time letting you know if certain predators turn up (links to cell, satellite and other low bandwidth systems).
Flexible input/output plug - this will be used to plug in a range of additional devices, eg speakers, lures, smart traps, communication platforms etc.
Link to phone app for set up and data management - rather than having a small screen on the camera we link to the phone so you do all the set up and data management there. This then syncs to the cloud analysis platform when you are back in data range.
Continual remote software improvements - we are constantly improving the functions and usability of the device. These improvements are available for free and can be remotely updated.
Low power mode - this uses less power than when running AI in real time and can extend the use of the camera by 3 times (this has the potential to improve further with new software updates). The reason the DOC AI cam requires so much more power than a trail camera is that it is vastly more sensitive.
Microphone - the DOC AI cam has an inbuilt microphone so it can be used to monitor birds and link to the AI bird classification system developed by The Cacophony Project. The microphone may also be used to monitor animals in the distance by playing sounds and listening for responses (see below)
Anti theft protection - the device can only be used on our platform and when it is used the GPS shows where it is. This essentially makes it useless to steal. It also has a mount for a padlock.
Solar power - can link to a solar power bank so you never need to change batteries
AI classification in real time on device - when this is enabled the device can be linked to traps to only activate when particular predators are present. This enables much higher catch rates as the traps can be more open e.g. leg holds, live capture cages or the Cacophony high interaction rate trap. It can also be linked to “smart lures” that can be activated when particular predators are seen e.g. sounds played, food dispensed, scent sprayed etc
NZ wide data coverage - linking to OneNZ data that connects to Starlink satellite means that you can be notified of predators anywhere in NZ near instantly. You will also eventually be able to receive an image of the predator and be able to send a message back to the camera to activate a trap and/or confirm a remote kill.
The unique set of features on the DOC AI cam have been chosen to allow a range of quite different conservation objectives. DOC AI cam can be used to:
Monitor predators - these devices see 3-20 times more predators than trail cameras plus it uses AI to automatically tell you how many of each type it can see. No more scrolling through images etc, you just get a table of predator activity (you can watch a video of each predator online if you wish). The data management has been built into the design to make monitoring very easy and scalable.
Understand predator behaviour - this is different than just knowing how many predators there are. Because the camera gets a full view of the predator (no delay in starting recording) you can see precisely how they are behaving. This allows unique understanding of predator behaviour not possible from traditional trail cameras that are designed for larger mammals like pigs and deer. As an example you can understand how predators follow scent trails or how they systematically avoid baited traps over time
Real-time notifications of predators - where there is data connectivity there can be instant notifications of any target predators you are interested in.
Activate traps just for certain predator types - the AI predator classification means you can have much more open traps that are more likely to catch predators but non-targets can harmlessly interact with traps. Also scent trails are created by non-targets that make it more likely for predators to follow them into the trap.
Monitor birds - the microphone means the device can also act as a full bird monitor. AI classification of different species on the online platform is continually improving allowing an overall bird index or counting different species of birds.
Intelligent lures - when linking the onboard AI classification to the flexible port you can set up all sorts of lures. For example if you see a particular type of predator play this sound, flash this light, spray this scent, release this food/poison.
Detect species at a distance - some species respond to sounds e.g. possums. So the device can play a sound and listen for a response to detect predators at a distance. It can also be configured to listen all the time and record certain types of sound that can be analysed by AI - e.g. finding rare bird species.
Custom projects - because there is a flexible port and an onboard programmable computer the device can be used for a wide range of other applications too. Just as an example the camera is used to detect wallabies crossing bridges. This could then be set to play a dog barking to deter the wallaby from crossing the bridge.
The DOC AI cam is all open source so anyone can take what we have done and modify it for any particular purpose they want.
Below is a table that shows the list of features and how they are combined to achieve a range of different tools for conservation.
The different shades of green show which parts are already available and widely tested or partly available or the ones we are working on. There are many things that could also be added but we are just listing the ones that are in progress or close.