[OUTDATED] Important - GZDoom repository now uses submodules

Here, developers communicate stuff that does not go onto the main News section or the front page of the site.
[Dev Blog] [Development Builds] [Git Change Log] [GZDoom Github Repo]

Moderator: GZDoom Developers

User avatar
Nash
 
 
Posts: 17465
Joined: Mon Oct 27, 2003 12:07 am
Location: Kuala Lumpur, Malaysia

Re: Important - GZDoom repository now uses submodules

Post by Nash »

Graf Zahl wrote:TortoiseGit has a "Submodule update..." entry in its context menu, that always does the trick. So far every time I had problems with submodules, "git submodule update" solved them, especially on macOS where all Git clients are shit, especially the expensive ones :twisted:

Ohhh, even better. Must've missed that.

User avatar
Chris
Posts: 2954
Joined: Thu Jul 17, 2003 12:07 am
Graphics Processor: ATI/AMD with Vulkan/Metal Support

Re: Important - GZDoom repository now uses submodules

Post by Chris »

Graf Zahl wrote:So far every time I had problems with submodules, "git submodule update" solved them
That seems to have worked. That gave me
Submodule path 'wadsrc_widescreen/static': checked out '9a7f5b066115d2e2d98b21e3a31021f5ca24eb47'
and wadsrc_widescreen/static now has stuff in it. Oddly, the first time I ran make afterward, I got a build error:
Could not read central directory from /home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3. (Is it a zipfile?)
Will proceed as if -u had not been specified.
Updating filter/chex.chex3/graphics/titlepic.png 1.7% [ 39527/ 40197] Deflate
Updating filter/chex/graphics/credit.png 1.9% [ 28514/ 29057] Deflate
...
Updating license.md 33.4% [ 227/ 341] Deflate
Updating mapinfo.lmp 0.0% [ 39/ 39] Stored
/home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3 contains 60 files (updated 60)
Could not rename /home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3.temp to /home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3: No such file or directory
Error copying file (if different) from "/home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3" to "/home/kitty/projects/gzdoom/build/game_widescreen_gfx.pk3".
However, running make again worked? No error this time and there's a 1.7MB game_widescreen_gfx.pk3 now.

But now we need to be told whenever there's a submodule update so we know to run "Submodule Update..." or "git submodule update", don't we? Since I don't think Git will do it automatically or tell you it needs to be done when a commit changes a submodule target commit (at least I don't remember it doing so).
User avatar
Graf Zahl
Lead GZDoom+Raze Developer
Lead GZDoom+Raze Developer
Posts: 49183
Joined: Sat Jul 19, 2003 10:19 am
Location: Germany

Re: Important - GZDoom repository now uses submodules

Post by Graf Zahl »

That's why submodules are only good for linking to side projects that are expected to infrequently update and not updating the submodule won't break things. IMO it's fine for the widescreen pack and also for ZMusic, but not for splitting off the common engine parts of GZDoom and Raze into their own subproject.
User avatar
drfrag
Vintage GZDoom Developer
Posts: 3150
Joined: Fri Apr 23, 2004 3:51 am
Location: Spain

Re: Important - GZDoom repository now uses submodules

Post by drfrag »

After pulling i got a conflict and an strange error message about wadsrc_widescreen\static and asked me to choose between restoring the "file" from index or delete it from index. I decided to restore it and the merge looks okay but then i had to commit another change to that "file" and i don't know what it's about.
User avatar
Nash
 
 
Posts: 17465
Joined: Mon Oct 27, 2003 12:07 am
Location: Kuala Lumpur, Malaysia

Re: Important - GZDoom repository now uses submodules

Post by Nash »

Which file was it complaining about? I made some changes:

- mapinfo.lmp was deleted
- non-Doom assets were removed out of 'master' and placed into the 'wip' branch instead
User avatar
drfrag
Vintage GZDoom Developer
Posts: 3150
Joined: Fri Apr 23, 2004 3:51 am
Location: Spain

Re: Important - GZDoom repository now uses submodules

Post by drfrag »

No, the problem was merging the GZDoom repository itself. The other change appeared after updating the submodule.
Do you mind if i remove the module and add you as remote and merge your stuff directly?
User avatar
Nash
 
 
Posts: 17465
Joined: Mon Oct 27, 2003 12:07 am
Location: Kuala Lumpur, Malaysia

Re: Important - GZDoom repository now uses submodules

Post by Nash »

You mean you want to embed the graphics directly into lzdoom.pk3? Sure, go ahead, but please be sure I am given full credit, thanks. :)
Blzut3
 
 
Posts: 3178
Joined: Wed Nov 24, 2004 12:59 pm
Graphics Processor: ATI/AMD with Vulkan/Metal Support

Re: Important - GZDoom repository now uses submodules

Post by Blzut3 »

Chris wrote:But now we need to be told whenever there's a submodule update so we know to run "Submodule Update..." or "git submodule update", don't we? Since I don't think Git will do it automatically or tell you it needs to be done when a commit changes a submodule target commit (at least I don't remember it doing so).
There are config options you can change if you want git to do the submodule stuff automatically. I forget what these are off hand, but I haven't tried them personally so I can't tell you what side effects they may have to make your life more painful than the default behavior.

Anyway, if a commit changed submodules you can tell since git status will show that the submodules are "changed." That's your cue to do a "git submodule update".

I definitely think submodules are less painful than people make them out to be (or rather I'm used to them), but hopefully the next dominant version control system (because nothing lasts forever) thinks long and hard about how to make them more intuitive.
User avatar
Rachael
Posts: 13793
Joined: Tue Jan 13, 2004 1:31 pm
Preferred Pronouns: She/Her

Re: Important - GZDoom repository now uses submodules

Post by Rachael »

drfrag wrote:After pulling i got a conflict and an strange error message about wadsrc_widescreen\static and asked me to choose between restoring the "file" from index or delete it from index. I decided to restore it and the merge looks okay but then i had to commit another change to that "file" and i don't know what it's about.
If you're getting that, what most likely happened is you didn't remove the folder and its contents first.

Check this commit: https://github.com/coelckers/gzdoom/com ... 15eafe0b0f

The first file (.gitmodules) enables the actual submodule in your working tree.

Then is the actual submodule (which is just a special folder in Git's perspective)

Then the last thing you notice the folder itself is actually removed. What's intended here, is to remove the entire folder, which makes way for the submodule folder.
User avatar
Graf Zahl
Lead GZDoom+Raze Developer
Lead GZDoom+Raze Developer
Posts: 49183
Joined: Sat Jul 19, 2003 10:19 am
Location: Germany

Re: Important - GZDoom repository now uses submodules

Post by Graf Zahl »

Blzut3 wrote: I definitely think submodules are less painful than people make them out to be (or rather I'm used to them), but hopefully the next dominant version control system (because nothing lasts forever) thinks long and hard about how to make them more intuitive.

A lot would be gained if git wasn't so stubborn to not automate their handling transparently - and if Github offered better support for them, like giving an option to automatically integrate their content in source packages. They are still the best option for referencing external code that is responsibly managed. The alternative would be making a copy and constant manual updates which ultimately cost a lot more time and are more prone to user errors.
User avatar
drfrag
Vintage GZDoom Developer
Posts: 3150
Joined: Fri Apr 23, 2004 3:51 am
Location: Spain

Re: Important - GZDoom repository now uses submodules

Post by drfrag »

I did a hard reset and deleted the folder before merging and it was the same again. But that was harmless, the later commit was a submodule update i did later after all.
The right option was restore from index BTW, the other made the folder disappear and i got no submodule. The conflict was unrelated and in other file.
About your newer update for the submodule does that commit actually do anything in my repository? I updated earlier but in case i hadn't done it i mean. I guess it doesn't and i need to keep updating manually anyway, becouse the pull command in tortoisegit doesn't include an option for submodules so must be the same as when you added it for the first time. And when i update for real there's another commit then.
Nash wrote:You mean you want to embed the graphics directly into lzdoom.pk3?
No, it would be the same but keeping the graphics (and credits) in my repository too. I still don't know what i'll do, thanks.
User avatar
drfrag
Vintage GZDoom Developer
Posts: 3150
Joined: Fri Apr 23, 2004 3:51 am
Location: Spain

Re: Important - GZDoom repository now uses submodules

Post by drfrag »

In the end i deleted the submodule, why you will ask. The reason is that when i pulled the TortoiseGit dialogue said it was updated but it wasn't and i'd need to do it manually (same as adding it for the first time) and then a new commit appears everytime. So expect that commit and a merge in PRs (unless i'm wrong). They are not well integrated it seems and don't update automatically.
@Nash: https://github.com/drfrag666/gzdoom/com ... 51efd37d8e
User avatar
Graf Zahl
Lead GZDoom+Raze Developer
Lead GZDoom+Raze Developer
Posts: 49183
Joined: Sat Jul 19, 2003 10:19 am
Location: Germany

Re: Important - GZDoom repository now uses submodules

Post by Graf Zahl »

I may copy these assets to the repo later - but only when all work is done. Since Git and frequently changing binary data don't mix well I do not want to pollute the repo with all these different revisions of image data. - that can easily bloat the .git folder by several 100 megabytes, depending on how often the files are being edited.

Of course with a repo like yours and its countless branches for different products, things will inevitably become harder.
User avatar
drfrag
Vintage GZDoom Developer
Posts: 3150
Joined: Fri Apr 23, 2004 3:51 am
Location: Spain

Re: Important - GZDoom repository now uses submodules

Post by drfrag »

Those assets are only in my master branch. I'll just copy and overwrite the files from the local WidePix repo the tradicional way and set the author to Nash.
I have three local repos (actually several more): Nash's, mine and yours. The issue is also present in the local copy of yours, i must update the submodule manually.
User avatar
Graf Zahl
Lead GZDoom+Raze Developer
Lead GZDoom+Raze Developer
Posts: 49183
Joined: Sat Jul 19, 2003 10:19 am
Location: Germany

Re: Important - GZDoom repository now uses submodules

Post by Graf Zahl »

No, those assets are not only in the master branch. They are in the reoo's store and will accumulate there, increasing the repo's size. Each new revision of such a binary file will get in there without being diff'ed against its predecessor. The only way to get rid of them is to rebase your repo and omit the commits where they were changed.

That's my concern here. As long as Nash is still editing these files, I won't copy them into the GZDoom repo.

Return to “Developer Blog”