How can i send the 2d navigation goal to rviz by voice command
How can i send the 2d navigation goal to rviz by voice command.
I plan to use pocketsphinx
ROS Resources: Documentation | Support | Discussion Forum | Index | Service Status | ros @ Robotics Stack Exchange |
How can i send the 2d navigation goal to rviz by voice command.
I plan to use pocketsphinx
pocketsphinx will work. I've done it that way. But of course the goal gets sent to move_base, not to RVIZ.
In my case, I created a node that takes the desired goal location from pocketsphinx as a string("door", "kitchen", etc) and lookup the pose information from a table, then send that pose goal to navigation stack. I discussed sending the goal in an answer to this post: https://answers.ros.org/question/2594...
*Update after follow on question: *
In comment below you ask how to do this in reality, but if you have it working on turtlebot then you should be able to extend to move_base as described above. It depends on how you want to do the voice the commands or rather what type of commends you want to give. Do you want to:
You may approach it differently given what it is you want to do. It sounds like you want autonomous navigation so I think option 3 is out so you'll need to decide between option 1 and 2.
I'll assume option 2 since option 1 really males no sense to me even though it is what you asked for.
Step 1 - add the names of the predefined locations to pocketsphinx
You'll use the voice_cmd.launch
file for starting.
voice_cmd.lm
and voice_cmd.dic
will both need updating with the new words you need pocketsphinx to recognize. Here is my voice_cmd.dic file to show pocketsphinx how to pronounce the words. This file includes words that did not come with the tutorial.
I got the phonetic spellings from this web page: http://www.speech.cs.cmu.edu/cgi-bin/...
BACK B AE K
BACKWARD B AE K W ER D
FORWARD F AO R W ER D
FULL F UH L
HALF HH AE F
HALT HH AO L T
LEFT L EH F T
MOVE M UW V
RIGHT R AY T
SPEED S P IY D
STOP S T AA P
COFFEE K AA F IY
COFFEE K AO F IY
TABLE T EY B AH L
KITCHEN K IH CH AH N
ROBOT R OW B AA T
DINING D AY N IH NG
CANCEL K AE N S AH L
REBECCA R AH B EH K AH
LASER L EY Z ER
ON AA N
OFF AO F
SING S IH NG
FRONT F R AH N T
DOOR D AO R
THE DH AH
BAR B AA R
REMOTE R IH M OW T
CONTROL K AH N T R OW L
WAKE W EY K
SLEEP S L IY P
The new words need to be added to .LM file and ... (more)
Hi, Yes to move_base using voice..
I have been able to successfully install pocketsphinx with basic commands like back, forward and all. I can control turtlebot in the simulation..
How do i use this to actually control my robot in reality? ps: my robot already does autonomous navigation but by sending goals on rviz @billy
https://answers.ros.org/question/3512...
Please see the link @billy
Thanks alot for all the help thus far.. Much appreciated
Hi @billy I have been at this all day and night and cant get to be able to use the voice (position 3 and 4) to send goals to the move_base..
Please assist when you do have the time Here is a link to the question: https://answers.ros.org/question/3512...
Asked: 2020-05-01 11:46:52 -0600
Seen: 364 times
Last updated: May 02 '20
Is it possible to have memory mapped messages in ROS?
who is heading the development of ROS?
Publisher Subscriber Teleoperation -- High Latency?
How to correctly use git with ROS
Why sound play doesn't use festival's default voice ?
detect/extract a "small" sphere using PCL