• We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.

Stellaris Dev Diary #35 - QA in Space

Hello everyone!

Today’s DD will bring a little light on QA work, and give a glimpse of odd and interesting bugs the team struggled with throughout the development of Stellaris. My name is Chandika, and I work as Embedded QA on Stellaris, alongside with Leo Larsson and Obidobi (partially). We are part of the Development Team, but we also have Central QA working with us. They are not assigned for any project for good, as they are working with all our titles.


For a deeper and detailed explanation on how Quality Assurance department works in Paradox Development Studios please check this Dev Diary written by Distantaziq, Embedded QA on Hearts of Iron IV.


Although QA job is not just reporting bugs and issues we find, this is what we are known for, bringing programmers to tears and despair. Also, it is the most visible part of our work, as you can see below.



The beginning

Very first bug ever that has been reported on Stellaris was, you could say, pretty important. Courtesy of MrNibbles, who found out that there was no Exit or Quit Game button present in game at all. Perhaps it was by design? ( ͡° ͜ʖ ͡°)

NoExitGameOption_01 (1).jpg

Jormungandur: "We didn't see a need for the player to be able to stop playing"



Migrating hair, clothes and other things

Throughout the life of Stellaris, many aliens seemed to have their own will to change looks. Some would say it’s the hottest spring/summer 2016 of the stellar fashion, and as a matter of fact, it wouldn’t be that far from true.
2016_02_17_5.jpg
pasted image 3.png



This Reptilian was called Fabalien in our QA team. We even made our own Emoji in the chat we’re using at work. It’s fabulous!
pasted image 3.png




Scientists sometimes would change their clothes, depending on which alien empire they would encounter.
5.png
6.png



Socially awkward Molluscoid would creep through the window while having a conversation with you. Don’t make eye contact!
7.jpg



Naming your empire

Let’s say you wanted to name your empire with one letter. It would be a pity if it wasn’t visible on the map, right?
8paint.jpg



I mean, one letter can be easily missed in the vast Galaxy full of wonders.
9pai.jpg


You gotta make sure other empires treat you seriously, Q.
10pai.jpg




Space whales preparing for war

Purely a graphical bug where Space Critters, Whales and Amoebas decided to look a bit more intimidating than usual.
11.jpg




Instant rebellions

Look at this kaleidoscopic galaxy! It was a result of instant rebellions that AI could not handle.
13pai.jpg




Honorable Mentions:

Tough love of planets and their satellites.
14pai.jpg



Some Space Amoeba corpses would display in Galaxy View. And they are huge.
15pai.jpg




The epilogue

Of course, being a QA is not playing games all day and occasionally reporting something that made your playthrough unpleasant. We are most famous for the ridiculous screenshots we capture, but it’s actually just a small part of our job. Our responsibilities include (but are not limited to): analysing risks of the project, keeping track of our internal database of issues, which also means regression (verifying if the issues previously reported were fixed), and giving continuous feedback on the project (what works well, and what should be changed). We are doing a number of different tests that would narrow the issues down, check if all the features are in and working etc. We have scheduled multiplayer tests twice a week, as well as exploratory testing that would help us focus on long game.


All things considered, there is never enough testing for the project, especially games like Stellaris, where anything is possible. That’s why I would like to thank our dear betas for helping us out a lot and doing all sorts of testing for Stellaris. Without you it wouldn’t be the same! :)
 

Attachments

  • reptilian.png
    reptilian.png
    833,9 KB · Views: 2.247
  • 9pai.jpg
    9pai.jpg
    229,3 KB · Views: 2.237
Last edited:
  • 156
  • 61
  • 3
  • 1Like
Reactions:
Cheers for the DD Chandika, and all the work of the QA team the betas on Stellaris :). On the by, in the spirit of HoI4's Errordawg, have you thought about having an ErrorBlorg to let you know when things go awry? :).
 
Instant rebellions

Look at this kaleidoscopic galaxy! It was a result of instant rebellions that AI could not handle.
View attachment 183999
Find that "bugged code" and re-introduce it as a new 4th crisis.

"A wave of dread and psychosis makes its way among all sentient beings across the galaxy. Every species is impacted differently, but one common denominator remains, their desire to lead their own lives without some leader controlling them."

Space whales start attacking any station or ship it comes across, Fallen Empires fall apart, and you have a short time to get it under control. Slavery doesn't work, purge would have to be planet wide on every single affected planet, and your fleet slowly disappears as their crews mutiny and taking your ships to disappear somewhere into the wide expanses of the galaxy.
 
Last edited:
  • 3
Reactions:
Very funny! I love seeing those screenshots.

I want to say that combat is a core mechanic for this game. Think of all the development effort and expense that has gone into designing ships and tactical combat; the icons, the coding, the 3D models. All that effort is spent and the aim is to make it an interesting dynamic between different weapon systems and technologies.

I have found and reported a bug with level 1 Mass Drivers and the end of combat screen pretends to show Accuracy but is not showing the percentage of shots that actually hit the enemy (it's in bug report forum as an addendum to my bug report on Mass Drivers).

The QA team needs to spend a full day just on testing combat. Combat has been in a poor state at release. Test max evasion Corvettes vs Battleships, test all the level 1 weapons, then level 2, test that accuracy is working. Test, test, test. Make a list of permutations and test and tick of each permutation.

Make the weapon lines different and balanced. For example, Armor is useless early game right now. So why give a tech early on that does nothing?

Once the battle system is actually working as designed, then information screens and tool tips need to be checked to ensure they are accurate.
 
  • 1
Reactions:
Find that "bugged code" and re-introduce it as a new 4th crisis.

"A wave of dread and psychosis makes its way among all sentient beings across the galaxy. Every species is impacted differently, but one common denominator remains, their desire to lead their own lives without some leader controlling them."

Space whales start attacking any station or ship it comes across, Fallen Empires fall apart, and you have a short time to get it under control. Slavery doesn't work, purge would have to be planet wide on every single affected planet, and your fleet slowly disappears as their crews mutiny and taking your ships to disappear somewhere into the wide expanses of the galaxy.

Ooh, I'd like that! A crisis that you can't fight with military power? Sign me up!
 
  • 1
Reactions:
i had the space amoeba bug with an mining station and with a hyperlane entry graphic in the centre of the galaxy. that was nice ^^

(kind of hoped for an endgame crisis with master of orion like super world in the centre of the galaxy. i knew it was only a bug but you absolutely have to make antarans in the centre of the galaxy with a 40k space station and a 60k fleet :p)
 
We aim to release an update for the 1.1.0 beta patch today, but we can't say for certain yet. as Hericage said, we don't want to make the same mistake again : )
hnnnng... haven't played Stellaris since Friday... having withdrawals man... need that patch bad.. hook a brother up, i give you whatever you desire!! Come on man I know you got some in that trenchcoat somewhere *convulses*
 
  • 1
Reactions:
Since there has not been any acknowledgement or explanation about the poor state of the game on release, or the huge backlash from the community about it, i feel doing a dev diary about Stellaris QA is a bit of a slap in the face.
 
  • 3
  • 3
Reactions:
huge backlash from the community about it,
I've lately been in places that this release seems quite solid. And you have devs here that are actively working on the stuff. If you check some major publishers forums after big releases you usually see no devs at all and angry gamers going around in circles.
And QA is rarely to blame - this is from personal experience.
 
  • 1
Reactions:
I agree with you, if this was any other game developer i probably wouldn't have bothered coming to the forums, but it isnt, this is a Paradox game, and me and plenty of others feel that the state of the game on release was sub par to Paradox standards. I also know devs really are watching the forums, and thats why im disappointed there hasnt been any official comment on the numerous threads about this subject. Im not saying QA is to blame here, but if you make a post about the QA for a game and then multiple bugs used as examples (according to comments in this post) are still in the game, it feels kinda sloppy and also somewhat proves my point. Im just saying releasing a QA themed dev diary might not be a great idea as the subject is rather sensitive right now.
 
  • 3
  • 2
Reactions:
The patch in question isn't even fully released yet. It is currently in Beta, and beta patches aren't automatically installed with Steam. You have to agree to have them installed in your game otherwise you don't get them installed.
 
  • 1
Reactions:
I agree with you, if this was any other game developer i probably wouldn't have bothered coming to the forums, but it isnt, this is a Paradox game, and me and plenty of others feel that the state of the game on release was sub par to Paradox standards. I also know devs really are watching the forums, and thats why im disappointed there hasnt been any official comment on the numerous threads about this subject. Im not saying QA is to blame here, but if you make a post about the QA for a game and then multiple bugs used as examples (according to comments in this post) are still in the game, it feels kinda sloppy and also somewhat proves my point. Im just saying releasing a QA themed dev diary might not be a great idea as the subject is rather sensitive right now.


Uggh.... I'm sorry man but people like you are why I so rarely come on these forums.
 
  • 4
  • 3
Reactions: