• We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.

HOI4 Dev Diary - AI & Feature Updates

Hi everyone! From the time we show off features in dev diaries and release a lot happens. Usually it's just bugfixing and work behind the scenes, but sometimes it can be bigger changes too. So today we will pick out some stuff that's changed since you last read about it. But first, but not least, lets talk a bit about AI development!

AI Updates
When we started with 1.9 'Husky' and La Résistance there were 2 main things we wanted to achieve. First we wanted to nerf Germany (without actually nerfing them) by giving resistance more teeth. This worked pretty well, as after we had made the new resistance system Germany would consistently collapse to large Polish uprisings behind its lines and needed to be told how to manage all that as well as control its equipment production better. Resistance is now constantly hurting garrisons and you don't pre-build garrisons, so stockpiling and not rushing units is more important.

The second thing is also related to Germany (its WW2 after all). For HOI (no matter the version really) we have always striven for a balance where Germany defeats the Soviet Union if the allies do not take pressure off by invading. This ensures that all of the big sides need to be active and if played by a player you need to step up. Now before we jump to the 10 pages of comments discussing if this is a realistic target... It is, for gameplay I think. History wise I am personally convinced that the Soviets would have beaten Germany on their own. It just would have taken a lot longer and been much costlier, and there isn't much point in playing the UK or USA if Soviets will just take care of Germany on their own (now now, please keep reading the rest of the diary before we start arguing what-ifs :p).

Anyways, in 1.7 the allies seldom pulled off invasions well enough, and pretty much only if they got lucky in Italy or punched up through Greece or something like that. Firstly we have made a bunch of improvements and bugfixes to weird parts of the invasion logic for the AI that makes them perform better. The biggest impacts came from limiting the AI from shipping troops back and forth across the globe and simply getting them to buffer up its forces in specific allied territories. USA specifically here will now station troops ahead of time in UK so that when its time to do invasions they are already in the neighborhood. We have also improved prioritization of different fronts to make sure AI gets the importance of Europe and when landings have been made successfully.

One of our most important tools when working on high level AI stuff and history tuning is the "History Logger".
This is a tool that we developed to observe AI gameplay. When enabled, it collects & dumps data on how game progressed during a particular run and its output looks something like this when run through a web interface:
output.gif


You can find two example runs here if you want to experiment with it:
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=1.zip
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=2.zip
Watch out they are very javascript heavy and take a long time to load up :)

Other than showing country borders, it can also show many other other details for a selected country such as diplomacy status, army/navy mission/air mission positions, orders, taken decisions/focuses/ideas, executed operations/operative missions and many other things. On top of that, the things are logged using log effect will also appear in these logs so you can have custom logs in your effects if you want. Here is an example from USA:

upload_2020-2-17_14-32-21.png


The lines are invasion orders and red heat map is the army of USA. You can already see that USA successfully invaded southern France and has invasion plans for Northern France and Denmark.

And here is an example to things that are logged. Logs are filtered by country tag ENG and "operation" and here we see all operations that are executed by England.
upload_2020-2-17_14-48-59.png


We use this tool every day in our nightly automated tests. Everyday we run a bunch of AI only runs with history logger is enabled and at the end of the day we get an email like this:
upload_2020-2-17_13-58-7 (1).png


Our nightly tests inform us if the game is crashed or not, if there are some tests that failed and if there are performance issues. In this particular example in one of the machines Germany was not able to beat France. When we check history logger output for that particular run we see the following:
ger_fails.gif

(Green: Germany. Red: Enemies. Blue:Allies. Yellow: Potential Enemies. Heat map is the army position for Germany.)

In this run we see that Germany is attacking low countries way too early, before Poland falls and the front north west front is prepared. This allows France & England to be better prepared and push through. The fix was to add extra safety checks (we had broken some old ones too in an unrelated change a while back) for how the AI wants to feel prepared for this push.

This tool will be included with 1.9 so modders can take advantage of it. We think is going to be super good for anyone doing balance, AI or total conversion mods. There will be more info on that as well as some more details and info on how to set up the tests in the Friday diary :)


Espionage Changes
We have done some changes to operative recruitment. Rather than being a timer on actual operatives recruitment time the system now is tied to the actual slots you have.
upload_2020-2-19_10-46-12.png

This was needed because the old system was pretty confusing in practice, and giving more operatives from events, or historical operatives would really mess with the progression of the system so UK could gear up its agency way too fast.

Operations have also had a bunch of changes. The more visible one is the addition of the Outlook indicator:
upload_2020-2-19_10-57-4.png

This breaks down risks and the potential for better rewards on an operation. Both can be affected by agency upgrades and Operative traits. A 10% risk means that there is 10% something goes wrong. This usually means that the operatives will need to go into hiding for a while to avoid local investigations, or have suffered an injury, or more rarely, have been captured, killed or turned to the other side. When operations end you'll get to find out as risk trigger generally when trying to extract from the operation area.

We have also added some new ministers for nations. Having an Illusive Gentleman will be a good choice for those who want to go all in on making the strongest Agency possible:
upload_2020-2-19_11-7-40.png

You can also see that UK will get access to all programmers hero Alan Turing if they develop a cryptology department. He is more of a UK special though.

Portugal Changes
Hello everyone, Mano de Zombi here!
As many of you have already noticed, there have been some changes to the Portuguese Focus Tree since my last DD before Christmas, and today I’d like to talk a little bit about them.

Let’s begin with the National Spirit Unstable Republic:

01 Unstable Republic.png


The previous stability penalty (a flat 10%) has been changed to a -0.5% weekly stability penalty.
Salazar’s trait has also been changed from a flat stability bonus to a 0.5% weekly bonus.

As you can see, one stability modifier counters the other. The reason behind this is that while Salazar is in power, his Unstable Republic will be roughly under control. Stability might not increase but it will not decrease either (after all, even with some difficulties, Salazar historically managed to keep the Republic under control for decades).
But once you start tweaking your politics, you can find yourself in a tough situation where low stability might not be easily recovered, putting your country on the brink of civil war before changing your government. More on this later in the diary.


Now let’s take a look at the final focus tree:

02 Portugal tree.png


As you can see, there are some new focuses (12 to be precise), for a total of 122.
During Christmas I worked on a design for the historical Salazarist branch, as well as a bit of reworking and additions to other branches. Big kudos to Pedro, the original FT designer, who helped me a lot and provided me with incredibly useful documentation!


The Military branch looked quite small so we decided to include three more focuses. This branch has also seen some changes, so let’s take a quick look:

03 Military Branch.png


Army Organization, Metropolitan Army and Corpo do Estado Maior will each grant some Army XP. In addition to that, Army Reorganization will remove Unstable Army National Spirit and add a small stability penalty(-5%).

To the left, Metropolitan Army also grants two research bonuses, followed by a production bonus under Standardization. The defensive focuses have not been touched, you must still choose between heavy fortifications in Lisbon or a light fortification line along the coast. Finally, Portugal has two focuses that provide research bonuses for special forces.

Tropas Paraquedistas is based on the Parachute Rifle Battalion, a group of 12 Timorese soldiers trained in Australia during World War II to be launched in the rearguard of the Japanese forces occupying Portuguese Timor; as you can guess, this focus gives a research bonus for Paratroopers.

Regimento de Comandos is a reference to the (later) historical Portuguese Commando Regiment (a special forces unit prepared for counter-guerrilla operations) formed in the early 60s, as a consequence of the Ultramar War; it will provide two research bonuses for special forces, as well as a National Spirit that will slightly increase your special forces limit.

To the right, we have Corpo do Estado Maior, which improves army leaders and makes them cheaper, followed by Staff Wargames and its two research bonuses for land doctrine. Finally, Field Maneuvers will add more Army XP and an additional research bonus for land doctrine.

A final note on this, if you support a Spanish faction during the Spanish Civil War, you can access a focus that also gives you some research bonuses (different bonuses depending on the faction you support):

04a They Need our Help.png


04b Observation Mission.png


04c Assist the Requetes.png



Moving on to the political branch, you can see that some focuses have changed names. This is to clarify that they are related to the Spanish Civil War:

05 Focus Renamed.png


You may also notice that Securing the Free World is now available only through Allow Free Elections (aka Democratic path). This focus will guarantee the independence of every European minor country with a democratic/non-aligned government and not in a faction, as well as allowing you to create your own faction. It makes sense to have it as a democratic focus, since Communists have their own ways to deal with factions.

06a Securing the Free World.png


I would also like to clarify the requirements for the following focuses:

Protect Chinese Civilians: Will grant a wargoal against the owner of Guangzhou, the state surrounding Macau. This focus is available by completing either The Popular Front Bloc, They Need our Help or Allow Free Elections.

Intervention in Spain: This focus grants a wargoal against Spain if their ideology does not match Portugal’s. It is available only through They Need our Help and Allow Free Elections.

06b Focus Requirements.png



Regarding the change of ideology, throughout the different political branches (be it Communist, Democratic, Fascist or even Monarchist) you will always find something like this:

07a CW main.png


As you can read in the lower red tooltip, if you attempt to change your government through the Focus Tree, you better make sure that stability is high enough, otherwise you could find yourself in the middle of a messy and unexpected Civil War (hmm… This sounds familiar to me…).

You will find something similar in the following focuses:

07b CW.png


07c CW.png


07d CW.png



Now let’s talk about the historical path (cool new icons in the branch courtesy of our freelance artist @Indyclone77, who also made all the Portuguese Focus and National Spirit icons, event pictures, and plenty of other 2D assets... Big kudos to him!). We have added a new sub-branch by which Salazar will slowly strengthen his regime, eventually turning Portugal into a powerful nation, capable of dealing with great powers late-game:

08 Historical Branch.png


The National Spirit Estado Novo represents the Salazar regime and has several levels now, being improved by different focuses along the branch.

You get it when you complete Estado Novo focus, providing a small bonus in consumer goods and civilian factory construction speed.

09a Estado Novo 1.png



Strengthen the Regime represents Salazar dealing with all kinds of dissidents (historically, Communists were specially persecuted and oppressed, but there were also other groups, such as fascist-syndicalists). You will have to invest some manpower and equipment to strengthen the secret police, but you will get some Non-Aligned support, and your Estado Novo will get small bonuses.

Upon completion of Appease Monarchists you will get the support of most monarchists and will unlock a couple of Monarchist-related advisors (shared with the Monarchist branch). Historically, Salazar’s strategy was to co-opt the Monarchy supporters into the government and leave the restoration of the Monarchy open for the future. Among other benefits, this focus will add a small daily PP and a weekly stability bonus to Estado Novo.

Concordat with the Holy See: The Concordat of 1940 was an agreement between Portugal and the Vatican, which basically prevented the Church from interfering in the political affairs of Portugal. In-game, you will get a nice amount of PP and Estado Novo will get a bit more daily PP and weekly stability.

National Gold Reserves: During the War, Portugal played an important economic role (it was more complex than the simple “they sold tungsten to Germany”, but I'll leave that for another day). In-game this focus will give Portugal a National Spirit with some economic bonuses, as well as better trade relations with Germany and the United Kingdom. Keep in mind: you have to be at peace to complete this focus!

By completing Honor Anglo-Portuguese Alliance Portugal will join the Allies, gaining access to the focuses shared with the Democratic Path.

Proudly Alone is the final focus improving Estado Novo and finally removing Unstable Republic. From here Portugal can choose to leave behind the historical approach and go into the offensive against Japan or any major or neighboring Communist nation.

09b Estado Novo 5.png



Last but not least, The Capital of Espionage focus: There were countless agents and plots in Lisbon during the war, from double agents and traitors who cooperated with former enemies to spies who gathered information on trans-Atlantic shipments for the Germans. This is represented in-game with the following National Spirit:

10 Spies.png



Regarding Refuse the Naval Blockade focus, it is now available not only through the Fascist path after National Syndicalism, but also through the Monarchist path after Return of Duarte. Now the Kingdom of Portugal can take revenge on the United Kingdom and finally connect its Angolan and Mozambican colonies (Mapa Cor-de-Rosa).

11 Refuse Naval Blockade.png



For those of you concerned about not seeing any custom tech sprites during the streaming a couple of weeks ago, I can confirm that there are Portuguese tech sprites, but unfortunately they were not hooked-in on the build we used for the streaming.

12 Tech Sprites.png



And that’s all from me, as you can see Portugal has gone through a lot of work during the last months and I hope you enjoy playing the different paths once the DLC is released!

For the next dev diary you won't have to wait a whole week as on Friday we will be showing off a bunch of stuff for modders as well as post the full 1.9 patchlog in preparation for La Résistance release next week.
Don't miss the stream today where we will continue our playthrough as Germany. Tonight we also have an AMA on reddit where you can pop in and ask us questions.
reddit_proof_iama_20200219.jpg
 
Last edited:
  • 2
Reactions:
In true pdx fashion you need to announce a £4 content pack with art for portugal and 3d infantry sprites for iberia
I'd pay that for a decent requetes sprite alone :D
 
Anything with regards to building up radar and naval infrastructure in the Atlantic via Madeira, the Azores, and Cabo Verde? Also reinforcing Goa in India in case of conflict against Britain/British Raj. Same for Timor Leste against Dutch Indonesia.
Maybe add a focus for the Allied portion of the tree that gives Portugal radar installations in the Azores and Madeira, to represent a hypothetical scenario of Britain selling radar equipment to an Allied Portugal?
 
I have to say I am a little disappointed by the Spanish sprites, would have hoped for at least different skins for Nationalists and Republicans, if not for 5-7 different skins (African, Fascist, Monarchist, Nationalist, Anarchist, Communist, Republican)

For me, the Biggest disappointment of the entire HOI IV series has been the lack of artwork for Portugal and Spain
 
Really appreciate that the team is taking grand strategy scenarios into consideration while tweaking the AI and the game's balance.

Unfortunately, it means nothing if they don't work on fixing the "little" problems that are imersion breaking. It doesn't matter how interesting the scenarios could be potentially if the AI does rookie mistakes that are obvious. It's a strategy games and your opponent needs to be minimally capable of playing the game. The player introduces dynamic variations, so no matter how interesting these scenarios might be (and they are to me), by the time you'd get to experience them in a playthrough, so much has changed that these targeted strategies might hurt the AI instead of helping. So, I'm not sure how to feel about this.
 
I hope you'll buff french AI as it often forgets to defend half of the border... (or not until i got the new challenge achivement)
 
Any chance you'll revise the custom tech sprites for France? French tanks, mechanised and arms would look very different if France never fell, as it shouldn't when a player controls it.

Basically, please replace the SARL tank!

Fantastic changes to Portugal and opening up the history debugger to modders
 
I am not an expert on Germany during WW2, but I would still like to remind everyone that it does not matter how much material you have at home if you cannot bring it to the front line. I was under the impression that the logistical capabilities of Germany was rather poor...

As for the dev diary, if the AI now is capable of actually maintaining troops in a given theatre, instead of moving them everywhere and anywhere all the time (UK), that would be a big improvement.

More like the Poles keep destroying the supply railroads, that really hurt the eastern front as Germany had to supply 3 areas (Western Europe, Nort Africa and Eastern Europe). If the allies didnt guaranteed Poland (for the 1vs1 scenario) then it would be really hard for the soviets to do anything as more troops would be protecting the railroads in Poland with a steady supply.
 
I have to say I am a little disappointed by the Spanish sprites, would have hoped for at least different skins for Nationalists and Republicans, if not for 5-7 different skins (African, Fascist, Monarchist, Nationalist, Anarchist, Communist, Republican)

I agree with the developers could not put different skins for each faction of the Spanish civil war but as I said I should have inserted another colonial skin model to represent the importance and repressive that they had in the rebellious side the known as "regulares " com formed by Moroccan troops and the Spanish legion who were more experienced troops of both sides as they did with the Netherlands in the last dlc
 
I agree with the developers could not put different skins for each faction of the Spanish civil war but as I said I should have inserted another colonial skin model to represent the importance and repressive that they had in the rebellious side the known as "regulares " com formed by Moroccan troops and the Spanish legion who were more experienced troops of both sides as they did with the Netherlands in the last dlc
well two different skins would have been nice, I mean theoretically a country could have 20 different skins to choose from, I would have prefered different skins for each bigger group which had distinct uniforms over spy planes.
 
More fun trawling through the AI history viewer...

Seems like GER won't invest a lot into espionage (because it's not tanks), or maybe this delays the investment
Code:
strat|GER|GER_we_are_bad_at_espionage_because_it_is_expensive_and_not_tanks
They do however create an intelligence agency, although after the war has started:
Code:
intelligence_agency|GER|1939.12.16: create agency
and they do do some stuff
Code:
crypto|GER|1940.2.19: started decryption ENG
intelligence_agency|GER|1940.2.24: do the agency upgrade: Government Cypher School

GER will go hardcore on occupied territory
Code:
occupation|GER|1939.12.16: changed law for Luxemburg to Military Governor
occupation|GER|1939.12.16: changed law for Wallonie to Military Governor
occupation|GER|1939.12.16: changed law for Vlaanderen to Military Governor

Looking at SOV, maybe they don't invest a ton into espionage either?
Code:
strat|SOV|SOV_the_nkvd_is_all_the_intel_we_need

Some really interesting stuff there. The one thing that I'm really reassured by is that all major's I looked at were taking espionage actions, either investing the spy agency or sending operatives on missions.
 
Really appreciate that the team is taking grand strategy scenarios into consideration while tweaking the AI and the game's balance.

Unfortunately, it means nothing if they don't work on fixing the "little" problems that are imersion breaking. It doesn't matter how interesting the scenarios could be potentially if the AI does rookie mistakes that are obvious. It's a strategy games and your opponent needs to be minimally capable of playing the game. The player introduces dynamic variations, so no matter how interesting these scenarios might be (and they are to me), by the time you'd get to experience them in a playthrough, so much has changed that these targeted strategies might hurt the AI instead of helping. So, I'm not sure how to feel about this.
Amen. I'm always stunned at how seemingly close these historical AI games look compared to real history. So many things are going wrong on all levels and then they get combined into a house of cards, hoping that from a large enough distance it looks like the real deal. The design goals are many, many steps ahead of where the game currently is.

Even when playing largely historical, this is a sandbox game. The quality of the sand, the small things, needs to be right first. Then we can talk about how many towers the sand castle should ideally have.
 
More fun trawling through the AI history viewer...

Seems like GER won't invest a lot into espionage (because it's not tanks), or maybe this delays the investment
Code:
strat|GER|GER_we_are_bad_at_espionage_because_it_is_expensive_and_not_tanks
They do however create an intelligence agency, although after the war has started:
Code:
intelligence_agency|GER|1939.12.16: create agency
and they do do some stuff
Code:
crypto|GER|1940.2.19: started decryption ENG
intelligence_agency|GER|1940.2.24: do the agency upgrade: Government Cypher School

GER will go hardcore on occupied territory
Code:
occupation|GER|1939.12.16: changed law for Luxemburg to Military Governor
occupation|GER|1939.12.16: changed law for Wallonie to Military Governor
occupation|GER|1939.12.16: changed law for Vlaanderen to Military Governor

Looking at SOV, maybe they don't invest a ton into espionage either?
Code:
strat|SOV|SOV_the_nkvd_is_all_the_intel_we_need

Some really interesting stuff there. The one thing that I'm really reassured by is that all major's I looked at were taking espionage actions, either investing the spy agency or sending operatives on missions.
hm will be interesting to see in action.
 
Code:
strat|GER|GER_we_are_bad_at_espionage_because_it_is_expensive_and_not_tanks
I think it was more like "We are bad at espionage because our head of military intelligence is an anti-nazi", but I guess that including that, what with players having 20:20 hindsight and all, might be a bit tricky...
 
Any word on Germany and the USSR not declaring war on each other? I realize that Germany wouldn't attack the USSR if I'm holding France, but what's stopping the USSR?

Does Japan hold/puppet China? Once I puppet China it's GG for USSR, China puts out so many units I have no place to put them without running out of supply.
 
Please FIX towed rocket artillery and motorized artillery on the left side of mobile warfare doctrine specifically Mobile Infantry there should be no reason for towed and motorized rocket artillery to be slower then towed anti tank and towed artillery.