• We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.

HOI4 Dev Diary - AI & Feature Updates

Hi everyone! From the time we show off features in dev diaries and release a lot happens. Usually it's just bugfixing and work behind the scenes, but sometimes it can be bigger changes too. So today we will pick out some stuff that's changed since you last read about it. But first, but not least, lets talk a bit about AI development!

AI Updates
When we started with 1.9 'Husky' and La Résistance there were 2 main things we wanted to achieve. First we wanted to nerf Germany (without actually nerfing them) by giving resistance more teeth. This worked pretty well, as after we had made the new resistance system Germany would consistently collapse to large Polish uprisings behind its lines and needed to be told how to manage all that as well as control its equipment production better. Resistance is now constantly hurting garrisons and you don't pre-build garrisons, so stockpiling and not rushing units is more important.

The second thing is also related to Germany (its WW2 after all). For HOI (no matter the version really) we have always striven for a balance where Germany defeats the Soviet Union if the allies do not take pressure off by invading. This ensures that all of the big sides need to be active and if played by a player you need to step up. Now before we jump to the 10 pages of comments discussing if this is a realistic target... It is, for gameplay I think. History wise I am personally convinced that the Soviets would have beaten Germany on their own. It just would have taken a lot longer and been much costlier, and there isn't much point in playing the UK or USA if Soviets will just take care of Germany on their own (now now, please keep reading the rest of the diary before we start arguing what-ifs :p).

Anyways, in 1.7 the allies seldom pulled off invasions well enough, and pretty much only if they got lucky in Italy or punched up through Greece or something like that. Firstly we have made a bunch of improvements and bugfixes to weird parts of the invasion logic for the AI that makes them perform better. The biggest impacts came from limiting the AI from shipping troops back and forth across the globe and simply getting them to buffer up its forces in specific allied territories. USA specifically here will now station troops ahead of time in UK so that when its time to do invasions they are already in the neighborhood. We have also improved prioritization of different fronts to make sure AI gets the importance of Europe and when landings have been made successfully.

One of our most important tools when working on high level AI stuff and history tuning is the "History Logger".
This is a tool that we developed to observe AI gameplay. When enabled, it collects & dumps data on how game progressed during a particular run and its output looks something like this when run through a web interface:
output.gif


You can find two example runs here if you want to experiment with it:
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=1.zip
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=2.zip
Watch out they are very javascript heavy and take a long time to load up :)

Other than showing country borders, it can also show many other other details for a selected country such as diplomacy status, army/navy mission/air mission positions, orders, taken decisions/focuses/ideas, executed operations/operative missions and many other things. On top of that, the things are logged using log effect will also appear in these logs so you can have custom logs in your effects if you want. Here is an example from USA:

upload_2020-2-17_14-32-21.png


The lines are invasion orders and red heat map is the army of USA. You can already see that USA successfully invaded southern France and has invasion plans for Northern France and Denmark.

And here is an example to things that are logged. Logs are filtered by country tag ENG and "operation" and here we see all operations that are executed by England.
upload_2020-2-17_14-48-59.png


We use this tool every day in our nightly automated tests. Everyday we run a bunch of AI only runs with history logger is enabled and at the end of the day we get an email like this:
upload_2020-2-17_13-58-7 (1).png


Our nightly tests inform us if the game is crashed or not, if there are some tests that failed and if there are performance issues. In this particular example in one of the machines Germany was not able to beat France. When we check history logger output for that particular run we see the following:
ger_fails.gif

(Green: Germany. Red: Enemies. Blue:Allies. Yellow: Potential Enemies. Heat map is the army position for Germany.)

In this run we see that Germany is attacking low countries way too early, before Poland falls and the front north west front is prepared. This allows France & England to be better prepared and push through. The fix was to add extra safety checks (we had broken some old ones too in an unrelated change a while back) for how the AI wants to feel prepared for this push.

This tool will be included with 1.9 so modders can take advantage of it. We think is going to be super good for anyone doing balance, AI or total conversion mods. There will be more info on that as well as some more details and info on how to set up the tests in the Friday diary :)


Espionage Changes
We have done some changes to operative recruitment. Rather than being a timer on actual operatives recruitment time the system now is tied to the actual slots you have.
upload_2020-2-19_10-46-12.png

This was needed because the old system was pretty confusing in practice, and giving more operatives from events, or historical operatives would really mess with the progression of the system so UK could gear up its agency way too fast.

Operations have also had a bunch of changes. The more visible one is the addition of the Outlook indicator:
upload_2020-2-19_10-57-4.png

This breaks down risks and the potential for better rewards on an operation. Both can be affected by agency upgrades and Operative traits. A 10% risk means that there is 10% something goes wrong. This usually means that the operatives will need to go into hiding for a while to avoid local investigations, or have suffered an injury, or more rarely, have been captured, killed or turned to the other side. When operations end you'll get to find out as risk trigger generally when trying to extract from the operation area.

We have also added some new ministers for nations. Having an Illusive Gentleman will be a good choice for those who want to go all in on making the strongest Agency possible:
upload_2020-2-19_11-7-40.png

You can also see that UK will get access to all programmers hero Alan Turing if they develop a cryptology department. He is more of a UK special though.

Portugal Changes
Hello everyone, Mano de Zombi here!
As many of you have already noticed, there have been some changes to the Portuguese Focus Tree since my last DD before Christmas, and today I’d like to talk a little bit about them.

Let’s begin with the National Spirit Unstable Republic:

01 Unstable Republic.png


The previous stability penalty (a flat 10%) has been changed to a -0.5% weekly stability penalty.
Salazar’s trait has also been changed from a flat stability bonus to a 0.5% weekly bonus.

As you can see, one stability modifier counters the other. The reason behind this is that while Salazar is in power, his Unstable Republic will be roughly under control. Stability might not increase but it will not decrease either (after all, even with some difficulties, Salazar historically managed to keep the Republic under control for decades).
But once you start tweaking your politics, you can find yourself in a tough situation where low stability might not be easily recovered, putting your country on the brink of civil war before changing your government. More on this later in the diary.


Now let’s take a look at the final focus tree:

02 Portugal tree.png


As you can see, there are some new focuses (12 to be precise), for a total of 122.
During Christmas I worked on a design for the historical Salazarist branch, as well as a bit of reworking and additions to other branches. Big kudos to Pedro, the original FT designer, who helped me a lot and provided me with incredibly useful documentation!


The Military branch looked quite small so we decided to include three more focuses. This branch has also seen some changes, so let’s take a quick look:

03 Military Branch.png


Army Organization, Metropolitan Army and Corpo do Estado Maior will each grant some Army XP. In addition to that, Army Reorganization will remove Unstable Army National Spirit and add a small stability penalty(-5%).

To the left, Metropolitan Army also grants two research bonuses, followed by a production bonus under Standardization. The defensive focuses have not been touched, you must still choose between heavy fortifications in Lisbon or a light fortification line along the coast. Finally, Portugal has two focuses that provide research bonuses for special forces.

Tropas Paraquedistas is based on the Parachute Rifle Battalion, a group of 12 Timorese soldiers trained in Australia during World War II to be launched in the rearguard of the Japanese forces occupying Portuguese Timor; as you can guess, this focus gives a research bonus for Paratroopers.

Regimento de Comandos is a reference to the (later) historical Portuguese Commando Regiment (a special forces unit prepared for counter-guerrilla operations) formed in the early 60s, as a consequence of the Ultramar War; it will provide two research bonuses for special forces, as well as a National Spirit that will slightly increase your special forces limit.

To the right, we have Corpo do Estado Maior, which improves army leaders and makes them cheaper, followed by Staff Wargames and its two research bonuses for land doctrine. Finally, Field Maneuvers will add more Army XP and an additional research bonus for land doctrine.

A final note on this, if you support a Spanish faction during the Spanish Civil War, you can access a focus that also gives you some research bonuses (different bonuses depending on the faction you support):

04a They Need our Help.png


04b Observation Mission.png


04c Assist the Requetes.png



Moving on to the political branch, you can see that some focuses have changed names. This is to clarify that they are related to the Spanish Civil War:

05 Focus Renamed.png


You may also notice that Securing the Free World is now available only through Allow Free Elections (aka Democratic path). This focus will guarantee the independence of every European minor country with a democratic/non-aligned government and not in a faction, as well as allowing you to create your own faction. It makes sense to have it as a democratic focus, since Communists have their own ways to deal with factions.

06a Securing the Free World.png


I would also like to clarify the requirements for the following focuses:

Protect Chinese Civilians: Will grant a wargoal against the owner of Guangzhou, the state surrounding Macau. This focus is available by completing either The Popular Front Bloc, They Need our Help or Allow Free Elections.

Intervention in Spain: This focus grants a wargoal against Spain if their ideology does not match Portugal’s. It is available only through They Need our Help and Allow Free Elections.

06b Focus Requirements.png



Regarding the change of ideology, throughout the different political branches (be it Communist, Democratic, Fascist or even Monarchist) you will always find something like this:

07a CW main.png


As you can read in the lower red tooltip, if you attempt to change your government through the Focus Tree, you better make sure that stability is high enough, otherwise you could find yourself in the middle of a messy and unexpected Civil War (hmm… This sounds familiar to me…).

You will find something similar in the following focuses:

07b CW.png


07c CW.png


07d CW.png



Now let’s talk about the historical path (cool new icons in the branch courtesy of our freelance artist @Indyclone77, who also made all the Portuguese Focus and National Spirit icons, event pictures, and plenty of other 2D assets... Big kudos to him!). We have added a new sub-branch by which Salazar will slowly strengthen his regime, eventually turning Portugal into a powerful nation, capable of dealing with great powers late-game:

08 Historical Branch.png


The National Spirit Estado Novo represents the Salazar regime and has several levels now, being improved by different focuses along the branch.

You get it when you complete Estado Novo focus, providing a small bonus in consumer goods and civilian factory construction speed.

09a Estado Novo 1.png



Strengthen the Regime represents Salazar dealing with all kinds of dissidents (historically, Communists were specially persecuted and oppressed, but there were also other groups, such as fascist-syndicalists). You will have to invest some manpower and equipment to strengthen the secret police, but you will get some Non-Aligned support, and your Estado Novo will get small bonuses.

Upon completion of Appease Monarchists you will get the support of most monarchists and will unlock a couple of Monarchist-related advisors (shared with the Monarchist branch). Historically, Salazar’s strategy was to co-opt the Monarchy supporters into the government and leave the restoration of the Monarchy open for the future. Among other benefits, this focus will add a small daily PP and a weekly stability bonus to Estado Novo.

Concordat with the Holy See: The Concordat of 1940 was an agreement between Portugal and the Vatican, which basically prevented the Church from interfering in the political affairs of Portugal. In-game, you will get a nice amount of PP and Estado Novo will get a bit more daily PP and weekly stability.

National Gold Reserves: During the War, Portugal played an important economic role (it was more complex than the simple “they sold tungsten to Germany”, but I'll leave that for another day). In-game this focus will give Portugal a National Spirit with some economic bonuses, as well as better trade relations with Germany and the United Kingdom. Keep in mind: you have to be at peace to complete this focus!

By completing Honor Anglo-Portuguese Alliance Portugal will join the Allies, gaining access to the focuses shared with the Democratic Path.

Proudly Alone is the final focus improving Estado Novo and finally removing Unstable Republic. From here Portugal can choose to leave behind the historical approach and go into the offensive against Japan or any major or neighboring Communist nation.

09b Estado Novo 5.png



Last but not least, The Capital of Espionage focus: There were countless agents and plots in Lisbon during the war, from double agents and traitors who cooperated with former enemies to spies who gathered information on trans-Atlantic shipments for the Germans. This is represented in-game with the following National Spirit:

10 Spies.png



Regarding Refuse the Naval Blockade focus, it is now available not only through the Fascist path after National Syndicalism, but also through the Monarchist path after Return of Duarte. Now the Kingdom of Portugal can take revenge on the United Kingdom and finally connect its Angolan and Mozambican colonies (Mapa Cor-de-Rosa).

11 Refuse Naval Blockade.png



For those of you concerned about not seeing any custom tech sprites during the streaming a couple of weeks ago, I can confirm that there are Portuguese tech sprites, but unfortunately they were not hooked-in on the build we used for the streaming.

12 Tech Sprites.png



And that’s all from me, as you can see Portugal has gone through a lot of work during the last months and I hope you enjoy playing the different paths once the DLC is released!

For the next dev diary you won't have to wait a whole week as on Friday we will be showing off a bunch of stuff for modders as well as post the full 1.9 patchlog in preparation for La Résistance release next week.
Don't miss the stream today where we will continue our playthrough as Germany. Tonight we also have an AMA on reddit where you can pop in and ask us questions.
reddit_proof_iama_20200219.jpg
 
Last edited:
  • 2
Reactions:
I mean I hope you nerfed Germany like you said but don't make the occupation cost tooooooo high, otherwise smaller countries(industrial and manpower wise) won't ever have a chance at a WC in singleplayer. Also, after you have peacedealed an annexed an area, will it still have resistance or not?

I know its a design goal for HOI4 but i so wished they would drop this particular one.
 
Agreed. IMO previous HoIs were far more spot-on when it came to minors and how to model them. Conquering the world as a minor in HoI4 should be as difficult as doing it as a <100k pop unciv in Vicky 2.

The reason I believe this is because it means either the AI is broken, there are game mechanics that are broken a combination or maybe something even worse. It is never a good thing for a player to be able to manipulate a game to that extent. It removes credibility.
 
For HOI (no matter the version really) we have always striven for a balance where Germany defeats the Soviet Union if the allies do not take pressure off by invading.
I feel this is a nice design goal from a gameplay perspective. And this it what matters most to me.

Now having that reconfirmed; I participated in a discussion about SU weakness some time ago in which I mentioned that SU does some really bad decisions in its build-up pre- and during the war. Some of which are the waste of PP on draft law although they have tons of manpower while staying at civilian economy, the continuous production of light tanks with almost no armor, the use of decisions to increase resource production although they had plenty... the list goes on.

Did you also have a look at these bad SU decisions, which might share a big part of the blame the SU was losing out against humans? Or would any fixes there still make the SU too strong against AI Germany?
 
in my book the allies being unable to invade germany or germany being bad at maintaining garrisons was the biggest issues we had so thats what we prioritized.

Getting team killed by your own faction should be right up there, probably higher. Especially because it ruins said invasions too.

AI execution of battleplans (and making battleplans actually work) would also be reasonable to give high priority since these affect everyone. Especially because you try to force us to use things like spearheads by heavily taxing a more practical UI input, it's vexing when they objectively don't work.

Why are we attacking backwards?

Even spearhead orders can and will attack provinces that are a) not in highlighted path and b) aren't even on the front line drawn. This obviously affects AI battleplans too.

I'm not convinced AI allies underperformance is a bigger issue than the controls not working, the AI's general usage of said controls, or the fact that "friendly" AI actively undermine the player and cost more games than hostile ones by flooding fronts with supply hell. An invasion or two more would succeed if they didn't team kill.
 
Last edited:
Thank you for updating Portugal, maybe in the future you can bring back the inquisition and Reconquista spirit to Portugal and Spain.

Reconquista? Why? Do you see Al-Andalus and Granada on the map at start? If you want to continue the Reconquista it might be hard since, well, North Africa is controlled by Spain and France. Inquisition would be silly too, the only thing I could think of to represent religion in Spain and Portugal would be the church mechanic that Mexico has.
 
Reconquista? Why? Do you see Al-Andalus and Granada on the map at start? If you want to continue the Reconquista it might be hard since, well, North Africa is controlled by Spain and France. Inquisition would be silly too, the only thing I could think of to represent religion in Spain and Portugal would be the church mechanic that Mexico has.

Did you saw the new formable nations? Recomquista and Inquisition i explained on Portugal thread, but it would be for more wargoal, reasearch and stability.

"I said this in other threads, but i'll say it again. Is a shame that Portugal and Spain have not any church mechanics. The Catholic church was a huge sponsor of both regimes and anti-comunist. Even if they went monarchic, the Church would support them. Before 1910 coup, the Catholic church was part of the State, in Portugal. Salazar was the one who "made peace" with Vatican. So both countries could start with a national spirit "Vatican..." that would change if they choose to go neutral, red, blue or brown. On the red path the church would sponsor stikes and sabotages, and it would need to purge, specially if going Anarchist, on brown or neutral, the realation would evolve to simbiose, leading to new spirits like "Missionaire" - boost on spreading non-aligned os fascist; "Crusader" - boost on justify war-goals; and one just for Portugal and Spain "Reconquista"- give claims on North Africa. Church could be used to stability and war support, for instance, as Portugal on historical neutral path, to choices, "One with the state" - more stability, research penalty, or "the Concordat" - political power, relations bonus. After that the choices would lead to a close or loose relation, like "Return of the Inquisition" - boost on espionage/counter inteligence or "Clerical studies" - research boost. Maybe in the future religion be a factor on the game, was it was for the war, but right now only Mexico as it.
Other thing that i mention was the fact that only by going comunist we can join a research group, i think that is about time to make this a simple political decision, any to countries that make a faction, should be able to make their research group on their own, but so far, either you are in the commonwealth or you go soviet. Please Paradox address this." - 1st posted on Portugal dev diary
 
Last edited:
Did you saw the new formable nations? Recomquista and Inquisition i explained on Portugal thread, but it would be for more wargoal, reasearch and stability.

So you want them to dedicate time to making another focus tree path for a formable tag for a releaseable tag who's goal is to completely annex Spain and Portugal? Sorry, disagree
 
I've asked this a few times already a few places, but I have not got an answer yet.
How do decoy units work in Single Player? I understand you can line southern England with decoy units in MP and make it appear like D-Day is happening somewhere else, but how does the AI deal with that in SP? From what I understand, the AI would not even take them into account at all and if these units were put on a frontline they would get instantly rekt.
Do decoy units "work" in SP or is an MP only feature?
 
Oh gotcha. When saying Division spam people have usually been talking about AI committing too many divisions vs their ability to supply them with equipment.

Supply issues like this with AI/Player remains an issue still unfortunatly, but its something we care about going forward, but this expansion was not the time to redo how supply functions. Does requesting expeditionaries from allies and directing them elsewhere help with the issues sometimes?
podcat, will the AI ever be opened up to us customers to tinker with so that we can work towards a better AI together?
 
podcat, will the AI ever be opened up to us customers to tinker with so that we can work towards a better AI together?
Not Podcat, and he can correct me if I am wrong but a hurdle is that a lot of ai stuff runs on compiled code and thus limiting how much is feasible to open to the public
 
  • 1
Reactions:
The revisions to the Portugal focus tree are very welcome, although we dedicated forum goers have been aware of them for some time. We appreciate you listening to our feedback on this issue.

I have to say, though, that it is pretty disappointing that the AI's proclivity to flooding supply zones until they're oversaturated is not being touched at all. In my opinion, that has been the single greatest issue with the AI(even though as we all know there are quite a few VERY significant issues, at least naval invasion is being addressed but we'll have to see how effective that is) and I've had it ruin several games. I've noticed in Germany games that AI allies tend to flood and oversaturate the supply zones in areas controlled by Romania, which seems to tie into the AI's weird logic about whether it should bring troops to the front.

While one can puppet Hungary and Romania and manually control their divisions, you cannot prevent Italy from doing so. The issue should not happen at all, but that it happens in the vital Ukrainian front and the soft underbelly of the Soviet Union is very disruptive and annoying. This issue is also extremely prevalent of you're playing an Allies game and start invading Europe.

Reading between the lines of Podcat's responses, it seems he has all but confirmed that 1. this issue will not be touched until the next DLC also implying that a major feature of said DLC will be a logistic rework, with the subsequent fact that 2. We'll have to endure this very severe issue for another full year.

I know people have varying opinion of sprites, but I am also disappointed that we will not see a Portugal infantry sprite. I hope that you have the opportunity to add this later in a patch, for owners of the DLC if nothing else.

I also have to echo @TheMeInTeam You guys really, really, really need to go back and try to work out some of the issues in the battle planner and with how planning bonus works. Not only would this help the player, it seems likely that the AI would also benefit from it.
 
Great changes, won't deny the attention to detail on some of those design decisions. However, I must still ask... Is the issue of Guard and Porto having switched populations and available slots fixed?
Guarda has Porto-tier population and slots, while Porto has Guarda-tier population and slots.
For those unfamiliar with Portuguese economy and demographics, switching Porto and Guarda is sort of like switching California with Colorado.

We got some new skins for Spain actually, but we didnt have time to do anything for Portugal
Understandable, but what about at least giving then the generic European ones like they should have from day 1? :rolleyes:
 
For me the big thing, regardless of the reason, is that there needs to be volatility in the end result of whether Germany successfully takes over the USSR, preferably rare rather than common. It definitely affects your gameplay if playing as an Asian nation. I want to not know. At first you could know the USSR would survive, which was bad news if playing as Japan, good news if playing as India or China. Then you knew that eventually the USSR would be taken over by Germany, which of course was the reverse (in addition to being less immersive).

If it feels likely that the USSR will survive, but there is still room for worry, I think from a gameplay standpoint that is the sweetspot, however that probability is accomplished. If the new result is that the western allies always achieve their landings and, once again, the USSR doesn't fall in any games, I'd say we still have a balance problem.
 
So you want them to dedicate time to making another focus tree path for a formable tag for a releaseable tag who's goal is to completely annex Spain and Portugal? Sorry, disagree

You are missing the point, the Reconquista was usuded by Portugal and Spain for their national unity. Having a "Reconquista" spirit does not necessarily means conquest Africa, but more stability for fascists and neutrals.
 
Not Podcat, and he can correct me if I am wrong but a hurdle is that a lot of ai stuff runs on compiled code and thus limiting how much is feasible to open to the public
Thanks for the reply. I don't really expect podcat to answer me until I ask the same question over and over every DD for 6 months.
 
Not sure if this has been adressed, but can I use a Spyplane as a spotter plane for the high sea so that my strike force fleet can leave the harbour after the enemy had been spotted