I just learned you need to make your systems CLOSED. Where you are controlling populations and close any potential of civilian interest in building items for you (from stimulus). In the star map, you will notice when you left click on a system - there is an option to open or close a system - an "open/close" button. The default setting is open - which means alien cultures can start to populate your systems. Trade is determined by the number of civilians you have in a system with a civilian station with a freighter. Some races have different climate tolerances than others. The Tarkans tend to like hot and dry climates - while the Liir's enjoy oceans and damp climates. As a result, if you are a Tarka and ally your self with the Liir you will notice Liir colonist's appearing on your colony worlds and going above your maximum total without negatively effecting moral and your biosphere as much. This happens if you leave a system in the default "open" status. Likewise, if you pump money in your stimulus you will also notice civilian interest in building items for you. You can prevent this, in systems you own by closing the system off.
The simply answer: The closing of a system will move you up. Opening of a system will move you down. Since the default option is open and thus you move down.
Left and Right is controlled by production vs trade.
The easiest way to move left and not right is to skip trade and pump everything into construction and production and it will tend to move left. Likewise, establish trades - create provinces and trade routes and you will tend to move right.
There are several other actions that will move it left or right and up and down than what I just mentioned - but this is the basics 101.
An easy way to move top left is to close every system and skip trade completly. If you want to move bottom right then get trade early and keep all your systems as open. Just remember, the default option is OPEN - so you will tend to move down and if you are a war monger building tons of stuff and dabble in civilian stations and trade - then you will tend to move towards anarchy.