Unable to clone full platform (LWIP2 git offline)

[TD-er]

The repository https://git.savannah.nongnu.org/git/lwip.git is offline.
This means the platform cannot be fetched.

Is it possible to define some archive somewhere as backup?
Now it is this external repository, but it may happen to some external repository some other time, so maybe it is good to be able to define some fallback location somewhere?

Since I'm not really sure where this could be done, I have also added a similar issue here: platformio/platform-espressif8266#184

[devyte]

Savannah seems to be online now.

possible to define some archive somewhere as backup

The only thing I can think of would be to clone it into github, but that would require maintenance to keep it up to date, which we're not willing to do atm. If anyone can think of some other way (mirror? automated update?), please post it here.

Closing for now.

[d-a-v]

@TD-er
This repository and its submodules should be cloned not recursively,
with git submodule update --init
not with git submodule update --init --recursive
Upstream lwip being a submodule of lwip2 which is a submodule of this repo, it doesn't matter if savannah is unreachable at the time of cloning. The core uses precompiled version of lwip2 anyway.

[TD-er]

@d-a-v So that's a configuration error where?
In this repo, or in platformio?

[d-a-v]

It's the way this repo is cloned.
What you reported was also an issue in CI, solved like this (unfortunately Travis CI's submodule option is implicitely recursive so it is disabled and made with fingers instead)

Can you point me to the PIO git-setup scripts ?

[TD-er]

Can you point me to the PIO git-setup scripts ?

Well, that question alone I cannot truthfully answer, since I hardly understand myself how the PIO stuff is being handled.
I think the magic is happening in the builder folder of this repo: https://github.com/platformio/platform-espressif8266

[mcspr]

See https://github.com/platformio/platformio-core/blob/develop/platformio/vcsclient.py
afaik those are invoked when package points to a git url

[d-a-v]

@ivankravets
Do you think --recursive can be optional in these lines or per-project disabled ?

[ivankravets]

@d-a-v Oh, I'm not sure. I think it's better to use PRE script and clone framework before to "packages" folder. See http://docs.platformio.org/en/latest/projectconf/advanced_scripting.html

[TD-er]

The site for the LWIP git may be online, but more than 50% of the time it is queried, it will fail to download.
So a lot of my Travis builds fail on this LWIP install.

[d-a-v]

@TD-er the reason why we use this external repository is because it's the official one and we prefer to not maintain an up-to-date copy.
I understand your issue and we had it too, like mentioned above (I explained how we solved it)

We can

• try and fix PIO scripts to not recursively download submodule
• modify lwip2 to download lwIP upstream sources by script instead of by submodule

[TD-er]

@d-a-v
Is either of these 2 options something I should do/change myself? Or is it something you plan to change in the scripts for this repo?

[d-a-v]

@TD-er I'd prefer some help from PIO nerds :]

[TD-er]

Hmm it may be hard to find nerds here.... ;)