Remove Duplicates and rewrite file unsorted

[maing]

Hi,

I have a file that I need to remove duplicates from. When the duplicates are removed, I need an output file that is unsorted - that is, it hasn't changed the order of the original file - that I'm getting the original file minus the duplicates.

Is this possible? Any ideas would be great!

[dbzTHEdinosauer]

use two sorts.

SORT 1:

• add 6 char to length of output file
• put seqno in new 6 char
• SORT file based on keys that will identify dups
• use drop dups

SORT 2:

• SORT key is seqno added by first sort
• use original record length (input to SORT 1) as length of OUTPUT, thus truncating the seqno added by SORT 1.

output of SORT 2 is a copy of your original minus the dups.
_________________
Dick Brenholtz
American in Varel, Germany

[maing]

Thanks!

It kinda does do it - it gives me the orignal file minus the duplicates but the file is sorted - I need the file in it's original order. I don't want the file sorted sequentially. Is there something I can add to the first sorting? :o

[dbzTHEdinosauer]

The seqno added (appended) to the output record needs to be added in the input phase of the sort, not the output phase, that way the seqno represents the original order.
_________________
Dick Brenholtz
American in Varel, Germany

[maing]

Excellent! That has worked a treat!

Thank you.