czech english

SubT Virtual Urban Circuit

Robotika Team

In parallel with System Track Urban Circuit starts also Virtual Track. This time we will keep two separate threads/blogs although they are connected — one team Robotika. While System Track is still "big unknown" for Virtual Track is already qualification world prepared, so let's have a look … Update: 8/1/2020 — Virtual Urban Circuit Qualification Results


Information from community forum (registration required):
Qualification for the Virtual Urban Circuit will require submitting a docker solution against the Urban Circuit Qualification scenario through the Tech Repo (https://subtchallenge.world/compete). In order to qualify, a team will need to submit a docker solution that is able to successfully report at least five of the artifacts within one hour of simulation time. Teams may submit against the Urban Qualification scenario as many times as they choose until the deadline for the Virtual Urban Circuit qualification, January 3, 2020 AoE.

Tunnel Circuit Virtual Teams,
We hope your fall is going well. This is a notice that your team has received a Team Qualification waiver for the Urban Circuit of the Virtual Competition based on your successful participation at the Tunnel Circuit event.
However, please stay tuned for the upcoming release of an updated Qualification Guide. We do plan to release additional guidance related to team registration and additional requirements.
We look forward to your continued participation in the SubT Challenge!

Content


10th October 2019 — Virtual Urban Circuit Environment Preview

Here is our first test in Simple Urban 01 world with ver25 from Tunnel Circuit with exploration set to 120s: https://youtu.be/FJ95uL_KYq4. PavelJ is already working on new configuration for robot X2 with lidar and RGBD camera, which looks promising: https://youtu.be/e-0GVTE35BA. We are currently waiting for official documentation on how to add new configuration.


2nd December 2019 — Ver31 - AWS logging

OK, it is time for some updates …
  • Robotika sent Letter of Intent to Participate in both System and Virtual Track of Urban Challenge (confirmed on Nov 22nd).
  • there is Ver31 which is now successfully storing OSGAR logfile via /robot_data topic (200670743174.dkr.ecr.us-east-1.amazonaws.com/subt/robotika:ver31)
  • the code is merged into master.
Any details? Well, there are some … for example we are not sure when it is guaranteed that the ROS bag recorder is ready (#276)? Also the version on AWS is more than 2 weeks old (#271). No, the version numbering is not available (yet?) (#256), so the only hint is output from simulation:
How we can tell? Well the entrance should be to the right so that robot X coordinates on staging area are negative. This was fixed and docker images are available, but not on AWS.
As a side-effect we found a bug:
Local planner selected as next goal (nearest to the goal) position behind the wall and end-up in local minima. Forever.
Just for reference here is the leader board:
Simply the leader board for Urban worlds is not working yet … maybe tomorrow? It is deadline for teams registration for System Track and only one month is left to Virtual Track (Jan 3rd 2020).
p.s. note Deleting Pods With no errors — I guess that this is result of huge logfiles. As a test I tried simulation of 5 robots of different types.

7th December 2019 — Ver33 - First point on AWS, Urban Practice 1

OK, we have now one point in Urban Practice 1 testing simulated environment.
It is backpack and in order to find it there were needed three changes:
  • disable collision detection — it simply does not work and crossing the entry gate causes several g reading. Moreover it looks like the organizers do not plan to fix this (see #243).
  • slow down turn from 45deg/s to 20deg/s — basically the same topic as above but the problem is odometry on X1 (large, Husky like) robot
  • classify all red objects as Backpack — in Urban Circuit is no Drill or Fire Extinguisher and new objects Vent and Gas are not red.
Here is the map from local run:
And meantime AWS simulation was completed with HD camera (X2 config 4), so here is nicer video what robot discovered.

25th December 2019 — CloudSim final release, new robot configurations and Ver36 with depth data

There are some news since the last blog update, in particular new CloudSim version with new robot configurations are available now on AWS — see SubT Release Notes & Updates (2019-12-20). Note, that this should be the final release for Urban Circuit, no more modifications a day before the competition end. We will see!
There is one close deadline: Qualification ends on Jan 3, 2020, i.e. in 9 days. If you check the scoreboard Urban Qualification then you can tell that new teams will have a hard time! Robotika is „leading” with zero points at the moment and you can see two new teams TunnelVision and Map Quickly. The team OSRF SubT RedTeam I believe is just testing team of the organizers and it will later disappear. If you want to qualify you have to score 5 points, and in particular you have to be able to navigate on the railway to next stations where are artifacts hidden. Definitely not easy task. The old teams from Virtual Tunnel Circuit have qualification waiver so that is the reason they do not worry much … (yeah, including robotika, but … if you are not able to qualify how you want to win?!).
The new logging system seems to be working fine, so I was able to download logs from two robots A10F300L and B50F300R, 200670743174.dkr.ecr.us-east-1.amazonaws.com/subt/robotika:ver36. BTW I like the new info feature
The results were not great. I am not able to extract log for robot A at the moment, but that could be an issue on my side (work in progress). And what about B robot? See some pictures from RGBD camera with 640x360 resolution (BTW that was another „lost case”, because this sensor should simulate RealSense2, see #295, but Resistance is useless, sigh).
The robot detected a problem on the stones:
0:09:06.926151 Pitch limit triggered termination: (pitch 26.5)
0:09:07.041879 maximum delay overshot: 0:00:00.115707
0:09:06.926151 Microstep HOME 0 248.373 pitch_limit
0:09:06.926151 go_straight -0.3 (speed: 1.0) (-67.239, -76.255, 0.105)
… backed-up 30cm and tried second side to exit this suspicious area. It worked, but … then it ended in endless loop:
… until it decided that it is time to go home.
To be continued.

5th January 2020 — Urban qualification is closed now

Yesterday (Jan 3, 2020, AoE, i.e. noon Central European Time Jan 4) was deadline for Virtual Urban Circuit Qualification. And the result? See Urban Qualification Leader Board:
In short it is not good for new teams: No team reached limit 5 points! There was a request to extend the deadline or lower the threshold on the community forum (restricted access) and the DARPA answer was:
The Virtual Urban Circuit qualification deadline and threshold will remain as outlined in the SubT Qualification Guide. We understand the challenges of autonomous navigation and artifact detection in these environments are difficult and require significant development time. You are encouraged to continue developing and submitting your solution to the Urban Qualification world and note there are more opportunities to compete in the Cave Circuit and the Final Event.
I agree that it is very hard to get some points in Urban Qualification world — see SubT Virtual Urban Qualification - 1st point/video. The point was collected by big wheeled platform X1 with QVGA camera (320x240) and 5 meters range lidar, the weakest sensor configuration. The motivation for X1 was large wheels so that it can overcome the bolts holding the rails. Note bad orientation on the rail, probably caused by the robot tilt (I hope). Also note, that the robot had to go all the way to the next station to be able to turn — it is not possible to do it safely on the railway. Yes at the final stage, when the robot is supposed to navigate on its own path, it failed too. The robot did not climb back to the platform. Nevertheless robot reported the artifact and the wall to base station was not too big so it scored 1 point!
The next attempts were with ROBOTIKA_X2_SENSOR_CONFIG_1 configuration (robot X2 with RGBD camera 640x360). Here the robot has to enter the rails very precisely to be able to explore it.
BTW robot X2 has sometimes problems to even turn on the platform — the wheels are narrow and they can get stuck in small gaps.
There were several versions since my last report and I did not properly document it :-(
  • Ver37 — experiment with depth2scan (conversion from RGBD image to be part of the lidar scan), optimization of Local Planner (it was too slow for this combination)
  • Ver38 — navigation along a trace (polyline) to explore the station platform. Cell phone detection. Scored 1 point in Practice2/video. Collected some data how to fall down from platform/video.
  • Ver39 — navigation down to the rails, scored one point in qualification world. Collected data of railway.
  • Ver40 — simulate slope lidar from RGBD depth image. Detected discontinuity and enhanced lidar scan by detected rails. Targeted to small X2 robot.
The final run was with five X2 robots and there was no happy end:
Well, we (robotika) are qualified thanks to waiver from Tunnel Circuit but there is a lot of work needed to successfully score in 25 remaining days to final submission!

8th January 2020 — Virtual Urban Circuit Qualification Results

OK, now is the qualification disaster official (restricted access):
Congratulations to the 8 teams who qualified for Virtual Urban Circuit! These teams provided narratives and had received score waivers for successfully submitting qualifying solutions to Tunnel Circuit. The teams competing in Virtual Urban Circuit are:
  • AAUNO
  • BARCS
  • COLLEMBOLA
  • Coordinated Robotics
  • CYNET.ai
  • Flying Fitches
  • Robotika
  • SODIUM-24 Robotics
We appreciate the new members of the SubT Challenge community who made significant progress with their solutions to the Virtual Urban Qualification world. We hope you will continue development to qualify for Virtual Cave Circuit and the Final Event.
Also the list of teams is now up-to-date (it seems to me that there are no new teams in both tracks).

Partners


Supporters