Problems Processing large projects

[eliotb]

Hello,

This is my first project I have done with pix4d, unfortunately I was just handed the work and the software and told to get cracking so my knowledge is limited at best. I recently completed drone surveys of an area roughly 40000m2, with all the different flights, the angles and the more freestyle flights I have over 40,000 images to use.

I have created different sub projects and uploaded 16 GCPs into PIX4D, but pix4d does not seem to be able to handle this amount of data. I started the processing yesterday and so far it seems to be stuck on 2% Calibrate and 2/15 total.

The computer that is running has the following spec, so i dont think this is the issue.

Processor - Intel Core i9-9900K 3.6GHz (Coffee Lake) Socket LGA1151 Processor - Retail

RAM - Team Group Vulcan Z T-Force 64GB (4x16GB) DDR4 PC4-24000C16 3000MHz Dual Channel Kit - Grey

Storage - Samsung 2TB 860 EVO SSD 2.5" SATA 6Gbps 64 Layer 3D V-NAND Solid State Drive (MZ-76E2T0B/EU)

WD 2TB Black 7200RPM 64MB Cache Internal Performance Hard Drive (WD2003FZEX)

Palit GeForce RTX 2060 SUPER DUAL 8192MB GDDR6 PCI-Express Graphics Card

ASUS PCE-N15 300Mbps Wireless N PCI-E Adapter

Microsoft Windows 10 Home Advanced - Systems

If anyone has any tips or advise this would be greatly appreciated.

Cheers

Eliot

[Pierangelo_Rothenbuhler]

Hi @eliotb

You mention 16 subprojects and 16 GCPs and that the processing seems to be stuck. However, it is not clear to me whether the processing of a single subproject seems to be stuck (or if you already merged multiple subprojects together) and how many GCPs each subproject has. Could you please clarify this?

In any case, you might want to try out Pix4Dmatic for such large datasets: https://www.pix4d.com/download/pix4dmatic

You can either try to run all 40’000 images at once, or make projects of about 10’000 images and run these separately. If you have GCPs the outputs should align well together.

For this large amount of data, please make sure you have a lot of free disk space when processing, otherwise it might stop due to lack of space.

Let us know if you have more information or if you try out Pix4Dmatic.

Cheers

[Andrew_Milanes]

64gb is not nearly enough memory for a project of this size. Even if you break it down into groups of 10,000 images, I would recommend at least 128gb. Don’t use the mechanical hard drive, it’s way too slow. Only use the SSD. The 9900K is a great cpu for gaming, but not Pix4D. But I know you can’t change the CPU. Here’s a link to recommended computer specs for Pix4D:

Puget Systems Pix4d Hardware Recommendations