This is a read only copy without any forum functionality of the old Modcraft forum.
If there is anything that you would like to have removed, message me on Discord via Kaev#5208.
Big thanks to Alastor for making this copy!

Menu
Pages: [1]

Author Topic: Removing Duplication  (Read 1402 times)

Drikish

  • Registred Member
  • GM Isle Explorer
  • *****
  • Posts: 22
    • View Profile
Removing Duplication
« on: May 28, 2014, 06:31:20 pm »
As a lot of you know, there are multiple duplication bugs in noggit, now i know how to prevent these now but what i do need is a fast way to fix my old ADT's corrupted by this bug. Using fileinfo and loadinfo, i have manually fixed some with hard searching, but all online tools seem to be looking for lines not certain parts of text. The best way i have found so far is the find and replace tool, but this can be very tedious. Does anyone know of another fast method, or one that at least tells me where duplication is and i remove it myself...
A not very good example of duplication - most of them are 50x more complex than this...

MMDX   2
0   worldexpansion03doodadsfirelandsfloatingrocksfirelands_floatingrock_02.m2
1   worldexpansion03doodadsgrimbatolraidgrimbatolraid_chogall_throne.m2

MWMO   2
0   worldwmocataclysmdeepholmfloatingrocksdeepholm_floatingrock01_angle.wmo
1   worldwmokalimdorhyjaltowerhyjal_small_tower.wmo

MDDF   21
1   41100122   2643.967773   33.559204   5961.853516   0.000000   1.333329   0.000000   1266
0   51000135   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000136   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000137   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000138   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000139   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000140   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000141   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000148   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000215   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000216   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000218   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000219   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000220   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000221   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000222   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000223   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000225   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000226   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000228   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999
0   51000229   3167.281982   1.357203   5749.951660   -182.000000   20.333389   -2.666665   999

MODF   42
1   41000007   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000023   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000028   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000033   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000038   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000043   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000048   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000053   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000058   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000063   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000068   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000073   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000077   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000078   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000079   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000080   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000081   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000082   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000083   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000084   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000088   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000093   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000098   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000103   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000108   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000113   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000118   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000123   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000128   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000133   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000138   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000143   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000147   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000148   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000149   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000150   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000151   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000152   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000153   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
1   41000154   2636.199707   -0.628684   5864.255371   0.000000   -90.666710   0.000000   2605.437012   0.647863   5842.747559   2672.195557   177.026230   5893.572266   0
0   51100000   3292.276367   81.694298   6309.203613   -29.333273   -127.333298   0.000000   3082.351074   -79.719643   6115.171387   3497.898193   241.327637   6517.041504   0
0   51100001   3292.276367   81.694298   6309.203613   -29.333273   -127.333298   0.000000   3082.351074   -79.719643   6115.171387   3497.898193   241.327637   6517.041504   0


Thanks - love Drikish
« Last Edit: January 01, 1970, 01:00:00 am by Admin »
Logged
Co-Owner \'Eversio\'

schlumpf

  • Administrator
  • Creator of Worlds
  • *****
  • Posts: 2967
    • View Profile
Re: Removing Duplication
« Reply #1 on: May 28, 2014, 06:39:38 pm »
Iirc, I did it using Excel back in the days. There, you can find duplicates in specific columns only.
« Last Edit: January 01, 1970, 01:00:00 am by Admin »
Logged

tehrob

  • Registred Member
  • Race Changer
  • *****
  • Posts: 39
    • View Profile
Re: Removing Duplication
« Reply #2 on: May 28, 2014, 09:28:38 pm »
Bug is rly anoying... tried it in Excel too like steff mentioned in a thread related to this.
But in most cases, my ADT fucks totally up after this.

I rly wish, some1 could fix this in Noggit 3 :(
« Last Edit: January 01, 1970, 01:00:00 am by Admin »
Logged

Chrispee

  • Registred Member
  • Race Changer
  • *****
  • Posts: 25
    • View Profile
Re: Removing Duplication
« Reply #3 on: May 29, 2014, 10:03:16 am »
« Last Edit: January 01, 1970, 01:00:00 am by Admin »
Logged

schlumpf

  • Administrator
  • Creator of Worlds
  • *****
  • Posts: 2967
    • View Profile
Re: Removing Duplication
« Reply #4 on: May 29, 2014, 10:29:17 am »
I mistakenly believed you. Excel is of course not needed at all. Use 'sort -uk2'. This will ignore the first column, then sort, then remove duplicates. Obviously do this on a per block basis or it will destroy the headers. Also remember to fix the count afterwards.
« Last Edit: January 01, 1970, 01:00:00 am by Admin »
Logged
Pages: [1]