A new story from Software Engineering Daily
Software engineering daily over the remaining five years of that regulatory time line and then in the successive years after that. How will your business strategy unfold? We at three. Dr Started by building the components for drones autopilots such than we became than we built. The drones themselves awesome became America's largest manufacturer drones then went to the Chinese. Got Really good at it. We got out of that and we moved over to the software so essentially software company. We just look at the data from from Jones. It's not the drums itself. That's not entirely true. We do actually have one of our cells for for people who can't earn on allowed to buy Chinese drones which is like the US government by and large where we're on the data side and so we used to be that it was quite hard to use a drone gather data. Now it's trivial easy to touch a button. Magic happens and the question is where's the return on investment on that day the highest so we start with construction then we went to the geospatial industries. Like the you know the birth work inspection that we talked about before your sting Pu- public public safety fire. Police picking up his well. We have just scratched the surface of. What's possible here? I think that you know what the regulation allows us to do is to go beyond that sort of visual site perspective so we're looking at like like bigger areas so although we started with autodesk and construction we're now actually working even more with with a geospatial stuff with like with as raise geospatial giant and. That's our main partner in this. Whatever they were doing with satellites years ago? They're increasingly doing with with drones. And the Nice thing about these regulations is that now we can. Now we can fly tens of kilometers you know so beyond visualized site so linear infrastructure power lines gas pipelines roads roads bridges tunnels airports. All that kind of stuff now is. That's now within the reach of what we can scan with drones. So I think you're GONNA see us. You can see more of the world fall within the scope of drones. We've already the battery. Life's already there. You know the flight times already there. The soon the regulations will be there and now you know think of it. We've been looking at pixels Oregon start looking at screens. What are the remaining technical barriers that feel the most acute right now? Ah almost none. I sort of feel like all the technical problems were solved years ago. I'm not that's not entirely true. But you know fully autonomous in including Centene Voids Company skied. Yo Right now doing amazing amazing work. But that's computer vision. Basically you know navigating through forests and through through leaves etcetera just using just using cameras. That's flying low when you fly higher you want to be able to avoid other aircraft and that's a harder computer vision problem. But there's this company called Iris Automation. That's doing that again with with cameras you know. The vehicles can fly almost any distance drones afloat across the mid-atlantic just use different fuel gas engines or hybrids or whatever. The radio links can go tens or hundreds of miles. The computer vision is amazing. GPS get better and better the software's kind of done on On all this this this almost nothing I can think of the drone delivery precision landing all that stuff. We basically benefit from the advantages in a and computer vision out there already so I literally cannot think of any technical problems right now. They haven't at least been solved at the university level. What about security well into fine define security? I mean the military has secure drones and has and has for many years. It's just you know. Do you want to do you want to have it like going. Through satellites nights encrypted sure can be done right now at the security is kind of whatever people want among the commercial space. It's standard Wifi to fifty. Six bit. Encryption encryption you can go you can pay more for for other security on the cloud side. We use fed ramp. There's really it's kind of what he want to pay it all exists. Let's imagine a construction site. I want to map that construction site or ensure the the safety I want to have an understanding of. What's going on in that construction site and so I'm going to use a drone to do that? Walk me through. What the drone is doing as it's flying over or through the construction site? How is the data getting recorded? How's IT getting sent to the cloud or is it like sitting on the drone and then the drone lands and you have to upload it take me through the technical process so I'll I'll describes her the optimal process and so far larger customers? They've kind of got it all all all very efficient. The optimal process is that this is being done every day. Maybe in the morning and the evening so you know the temporal resolution you know not just not just the spatial but because we objective here is to create what's called digital twin back in the day you know. Construction was started on screens with cad file but the moment they started digging it was analog paper. Blueprints need notepads and things like that we want that digital file that the digital plan to reflect reality so you know as they say you know no no no plan survives the first shot you know. Construction projects survives the for spader. Yes something changed. And so if you don't update the digital filed and that digital file you know there's interpreted it it sort of loses its relevance as it becomes less and less reflective of reality. So there's something called reality. Capture and the objective is to have the digital file software. You wanted people commit their software back to you. Know the the you know the master. So the masters nautical so in this case. The it's not it's not aww repository. It's a it's a cad file and that cadfael should be updated every day to reflect reality. How do you reflect reality? Well back in the old days people have to type in. Here's what I did too laborious now you want it. You want the scan to automatically capture reality and then update the file to show what happened to win so that that's what we're doing at at the headquarters they've said okay. This is this is the site and we want it to. Let's say capture the whole scan both horizontal and the vertical structures WanNa capture at in seven o'clock in the morning and at five o'clock at night and so the plan is the sitting some spot in the box. What's going to happen is that somebody's going to walk in the the site in the morning on lock? The gates locked the trailer. Turn on the generator and open the box and take the drone out maybe stick battery and at that point somebody will. Construction worker will touch a button on an IPAD and a plan that has already been loaded to that. IPAD from headquarters is going to be uploaded to Joan. Joan will take off. It'll do a lawn mower pattern hatter nor Peru or circular pattern or spiral pattern depending on what the site is at the point. It'll take about some between nine and ten minutes to do the whole site. It'll it'll take probably about two hundred images flying about about two hundred and fifty feet and then a land on its own at that point is someone who will put the back in the box touch another another button on the IPAD and the injury from that tyrone will go into the IPAD and then automatically buffalo to to the cloud to cloud at that point all those photos then get through a process to photograph maitree all those photos get get sort of analyzed and basically the way photograph works. It's called called structure from motion. But when and you see the same object from different perspectives using the paradox effects. You can actually see the depth you can have that so although the the photos to D- when you combine a bunch of two D. photos you end up with a three three d three D model and that'll be a point cloud or mesh or something like that. So that's automatically generated. Then that is automatically syncs up with the the cad file and when you have these things called ground control points so in the course of flying over its certain features are known had known position they have like an ex or some sort of fiduciary optical fiduciary automatically maquis recognize. And so that aligns this three d model to the same locations and so it snaps into location and now this becomes a layer in the cad file and and you can basically scroll forward and backwards through time and see how and see how things change and because these are meshes they're actually geometry's which can be snapped on. Snap and Khanin in alignment with the underlying catfight and you can say oh. That post was supposed to be here. But it's actually two meters over. There's probably a reason why they moved. That post two meters overdoes rock or something like that. Okay okay well. That's good to know now that now the digital twin says okay guys going forward. No that that post is now. It was supposed to be now over here. So when you put the trench now now put Trenton. I have to move the trenches well and you know when you're when you're going to be cutting the That you know the steel beam to go in that post note. The steel beam can have to be changed as well so now all all that information goes into the supply chain in the scheduling going forward and they make better choices because it reflected reality. Your software is open source or some of it It's it's actually not so the software and the drone so the drone might be using our the the software that we originally you know developed or or the software that we're now are working on as part of the drone code project is part of the next foundation says suffer on the drone is probably open source might be a degi vehicle which is closed source or might be one of one of the open source wants based Tantrum Code. That's just you know to operate the drone and mission and all this stuff. The data on the other hand goes into the cloud. And that's all closers. What's the reasoning behind? And the open source project. Is You just join or CO founded the foundation projects credit. Yeah Okay what have been the ramifications of the open source. I mean just to give some context. I You told quite a great story at at the Open Core Summit Guy I you know. We can't go through that in the entirety but maybe you can give a condensed highlights version of that story. Perhaps the evolution of your code being used by constituencies of various ethical. Flavors got it. Got It okay. Yeah so when I started I started as a as a hobby. Maybe I was. The editor of wired it was doing. My kids became a community. It took off and everything I do as a community has always been open source. You know whether it's you you know creative Commons or or actual code so it was just a default open because it was a hobby you know and and then as it got as it got bigger it became better organized and you know proper code development processes and and maintainers and things like that as it got bigger yet it became clear that we had the opportunity to create attention the android of ABC's Amand Aerial Vehicles. And I was like okay. Well you know this is starting to look like smartphones..