Scanning through a large Data

I am trying to scan through a large dataset to obtain information as well as pattern discovery. The dataset consist of 8 fields with different data types. i wrote a for loop and an inner for loop with a conditional if statement for conditioning. It is not displaying any errors, but it is taking long time to execute with the size set to 1,000,000, its ltaking hours. So what do i do, i need these to perform analysis on the dataset.

Answer 1

[Image Analyst]

We can't suggest much without seeing your code. A million datasets with 8 fields is not large. I deal regularly with data (images) that have more than 8 million numbers in them and usually the operations take a few seconds or less, not hours. So I would think that your data, which is much smaller than most digital images these days, should not take long. But it depends on how much stuff you were doing on each element. Maybe you're doing something that can be vectorized for a tremendous speed up. We can't tell until we see the code.