# Large data Project

**URL:** <https://community.pix4d.com/t/large-data-project/5578>\
**Category:** PIX4Dmapper Questions/Troubleshooting\
**Created:** [August 19, 2016, 3:53am UTC](https://community.pix4d.com/t/large-data-project/5578 "2016-08-19T03:53:36Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![hamemayu\_lima](https://avatars.discourse-cdn.com/v4/letter/h/919ad9/32.png) [@hamemayu\_lima](https://community.pix4d.com/u/hamemayu_lima)\
**Post date:** [August 19, 2016, 3:53am UTC](https://community.pix4d.com/t/large-data-project/5578/1 "2016-08-19T03:53:36Z")

</div>

Hi…

I will process large image to produce DEM and orthomozaik (about 21.000 photos). I have to split my project (3000 photos each project) and each project consist 3-4 GCP. I will ask some question.

1. first step is I have to do step 1(initial processing) in each project.

2. Then input GCP in each project and then “reoptimized”

3. what’s the next step? merged all project into 1 project and then do step 2(point cloud and mesh) or go to step 2 and 3 and then merged the project.

i hope this forum will give me idea…

&nbsp;

thanks a lot

---

<div class="post-metadata">

**Author:** ![Julie\_Pichon](https://sea2.discourse-cdn.com/pix4d/user_avatar/community.pix4d.com/julie_pichon/32/592_2.png) [@Julie\_Pichon](https://community.pix4d.com/u/Julie_Pichon)\
**Post date:** [August 23, 2016, 4:27pm UTC](https://community.pix4d.com/t/large-data-project/5578/2 "2016-08-23T16:27:46Z")

</div>

Hi Hamemayu,

Here is the article you were probably looking for about processing large datasets: [https://support.pix4d.com/hc/en-us/articles/202558579](https://support.pix4d.com/hc/en-us/articles/202558579)

Let us know if something remains unclear.

Regards,

---

<div class="post-metadata">

**Author:** ![Gyula\_Solyom](https://avatars.discourse-cdn.com/v4/letter/g/74df32/32.png) [@Gyula\_Solyom](https://community.pix4d.com/u/Gyula_Solyom)\
**Post date:** [October 9, 2018, 7:45am UTC](https://community.pix4d.com/t/large-data-project/5578/3 "2018-10-09T07:45:47Z")

</div>

Dear Julie!

We are having issues with moderately large datasets. One half of the project seems to be OK, the other is tilted 30 deg down (see the attached picture). We have 2200 24Mpix images, which is not that much. Any suggestion besides splitting the project into 2?

---

<div class="post-metadata">

**Author:** ![Blaz](https://sea2.discourse-cdn.com/pix4d/user_avatar/community.pix4d.com/blaz/32/4344_2.png) [@Blaz](https://community.pix4d.com/u/Blaz)\
**Post date:** [October 9, 2018, 10:30am UTC](https://community.pix4d.com/t/large-data-project/5578/4 "2018-10-09T10:30:52Z")

</div>

Hi Gyula,

It is highly&nbsp;recommended to add more GCPs in the project, especially where the flights intersect in order to ensure that the flight gets connected together and in order to avoid blocks. As a general rule, between 5-10 GCPs per flight are recommended.&nbsp;

If possible, placing additional GCPs and MTPs in the project and the intersecting area would be beneficial.

---

<div class="post-metadata">

**Author:** ![Gyula\_Solyom](https://avatars.discourse-cdn.com/v4/letter/g/74df32/32.png) [@Gyula\_Solyom](https://community.pix4d.com/u/Gyula_Solyom)\
**Post date:** [October 9, 2018, 3:11pm UTC](https://community.pix4d.com/t/large-data-project/5578/5 "2018-10-09T15:11:29Z")

</div>

Hi Blaz,

Yes, we had 7 or 8 GCPs, which are not included in this particular run, but we have tried to proecees the dataset with GCPs in all different combinations. When&nbsp;we have GCPs the project gets bent instead of broken. I just attached a picture showing strange behavior what you might have experienced before. Last time splitting the project into two parts helped, just makes processing more time consuming.

---

<div class="post-metadata">

**Author:** ![Blaz](https://sea2.discourse-cdn.com/pix4d/user_avatar/community.pix4d.com/blaz/32/4344_2.png) [@Blaz](https://community.pix4d.com/u/Blaz)\
**Post date:** [October 10, 2018, 7:40am UTC](https://community.pix4d.com/t/large-data-project/5578/6 "2018-10-10T07:40:06Z")

</div>

There is no general rule on how to proceed, but when dealing with corridor projects, uniform and flat surfaces, the breaking, and bending of projects is more likely to happen.

I would recommend the following:

- Splitting the projects in two part and process them separately.
- Using GCPs in MTPs in both subprojects.
- Once the subprojects are successfully&nbsp;processed, merging them.
- I would also recommend checking the [camera optimization in the Quality Report](https://support.pix4d.com/hc/en-us/articles/202558679-Quality-report-specifications#label09). In case that the initial and optimized values vary a lot, using the [All Prior](https://support.pix4d.com/hc/en-us/articles/205327965#label2) option could solve the bending issue.&nbsp;

---

<div class="post-metadata">

**Author:** ![Gyula\_Solyom](https://avatars.discourse-cdn.com/v4/letter/g/74df32/32.png) [@Gyula\_Solyom](https://community.pix4d.com/u/Gyula_Solyom)\
**Post date:** [October 10, 2018, 2:33pm UTC](https://community.pix4d.com/t/large-data-project/5578/7 "2018-10-10T14:33:44Z")

</div>

Thanks Blaz!

Is it the same in Standard and Alternative Calibration process (optimize camera calibration parameters with All Prior)?

We had the experience, that alternative calibration is less precise when having Checkpoints.

Best,

Gyula

---

<div class="post-metadata">

**Author:** ![Blaz](https://sea2.discourse-cdn.com/pix4d/user_avatar/community.pix4d.com/blaz/32/4344_2.png) [@Blaz](https://community.pix4d.com/u/Blaz)\
**Post date:** [October 12, 2018, 9:37am UTC](https://community.pix4d.com/t/large-data-project/5578/8 "2018-10-12T09:37:50Z")

</div>

&nbsp;

Alternative&nbsp;Processing Mode is recommended for processing aerial nadir images of projects where:

- The ground looks&nbsp;essentially flat in the images due to the proportion between the height&nbsp;of the objects and the height&nbsp;of the flight.
- There is **good image geolocation**.

If both of the conditions are fulfilled the Alternative&nbsp;Processing Mode can be used.

As for the All Prior, it is a way to force the calculated internal camera parameters to stay close to the initial parameters. This options should be used when large differences between the initial and calculated parameters are detected, regardless of the processing mode (Standard, Alternative or Accurate Geolocation and Orientation).

In case that you have a dataset with both accurate geolocation&nbsp; **and&nbsp;** orientation, you could also give it a try with the accurate geolocation pipeline as described in the&nbsp;[FAQ on the accurate geolocation pipeline](https://support.pix4d.com/hc/en-us/articles/360015702911-FAQ-on-the-accurate-geolocation-pipeline).
