In ELearning - settings - manage menu - self training - edit: the up and down arrows work and then shows the new arrangement of menu items, but this does not seem to do anything anywhere in the system? (Or have I just not found it yet?)
if you change the settings in the admin section, the changes are not automatically reflected in the courses. You have to re-assign the updated menu to the courses where you want it to be used.
Updated menu will instead automatically be shown in courses created with it AFTER the update.