Metatron-discovery: Determining column count on file datasets

Created on 1 Feb 2019  ยท  9Comments  ยท  Source: metatron-app/metatron-discovery

Is your feature request related to a problem? Please describe.
If the column count varys row by row, it's difficult to choose how to determine the column count.

Candidates was below:

  1. Just the 1st row rules. (datasource way)
  2. Visit all the rows, and choose the biggest. (dataprep way)

Describe the solution you'd like

  1. Visit all rows up to upload preview limit, and choose the biggest.
  2. Show to user, and the text control editable. (Not commonly)

Describe alternatives you've considered

  1. Just the 1st row rules. (datasource way)

Additional context
finefood.sample.txt
If you import and wrangle (use colon as delimiter) the file above, you'll see 12 columns in upload preview, 34 column in I.DS preview. The bigger file (not sample) results 55 columns. (Someone used http references or just so many columns)

enhancement @dataprep

All 9 comments

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2019-03-13 แ„‹แ…ฉแ„’แ…ฎ 4 30 47
@joohokim1 @AnnieHwang ์ฒจ๋ถ€ํ•œ ์•ˆ์œผ๋กœ ์š”๊ตฌ์‚ฌํ•ญ์ด ํ•ด๊ฒฐ๋ ๊นŒ์š”? ๊ฒ€ํ†  ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค-

@minjung-cho @AnnieHwang

์œ„ ์žฅํ‘œ ๋‚ด์šฉ ์ค‘์—, paragraph๋กœ ํ–‰์ด ๊ตฌ๋ถ„๋˜๊ณ , period๋กœ ์ปฌ๋Ÿผ์ด ๊ตฌ๋ถ„๋œ๋‹ค๊ณ  ๋˜์–ด์žˆ๋Š”๋ฐ, ์ด๊ฒƒ์€ ๋ฏธ์Šค ์ปค๋ฎค๋‹ˆ์ผ€์ด์…˜ ์ธ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค. (์•„๋งˆ ์ œ๊ฐ€ unstructured data๋ฅผ ๋…ผํ•˜๋ฉด์„œ ํ–ˆ๋˜ ์–˜๊ธฐ์ธ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.) ์‚ญ์ œํ•˜์…”๋„ ๋  ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

ํ™”๋ฉด ๋””์ž์ธ์€ ์ข‹์Šต๋‹ˆ๋‹ค. ์˜ค๋ฅธ์ชฝ ์„ค๋ช… ์ˆ˜์ • ํ›„ (๋‹ค๋ฅธ ์˜๊ฒฌ์ด ์—†์œผ์‹œ๋ฉด) ๋ฐ”๋กœ ์ง„ํ–‰ํ•˜์‹œ๋ฉด ๋  ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค.

์ฐธ๊ณ ๋กœ ์žฅํ‘œ์— ์–ธ๊ธ‰๋œ "๋ฐ์ดํ„ฐ์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ž๋™์œผ๋กœ ํ–‰๊ณผ ์ปฌ๋Ÿผ์ด ๊ตฌ๋ถ„๋จ"์€ https://github.com/metatron-app/metatron-discovery/issues/1654 ๋กœ ์ง„ํ–‰๋ฉ๋‹ˆ๋‹ค.

@joohokim1 ๋„ค, ๋ง์”€ํ•˜์‹  ๊ธฐํš์„œ ์˜ค๋ฅ˜๋Š” ๊ธฐํš ํŒŒ์ผ์—์„œ ์‚ญ์ œํ•ด ๋‘๊ฒ ์Šต๋‹ˆ๋‹ค.

@AnnieHwang ๋””์ž์ธ ๊ณต์œ ๋“œ๋ฆฝ๋‹ˆ๋‹ค

  1. column count ์ถ”๊ฐ€ : CSV,TXT,Excel ์—๋งŒ ๋ณด์ž„
  2. ์—๋Ÿฌ ์œ„์น˜ ์ˆ˜์ •
    image

@minjung-cho Column Count๋ผ๋Š” ๋ ˆ์ด๋ธ”์ด... ๋ญ”์ง€ ์ž˜ ์ดํ•ด๊ฐ€ ์•ˆ๊ฐ€๋Š”๋ฐ... ์ข€ ๋” ์‚ฌ์šฉ์ž๊ฐ€ ์•Œ๊ธฐ์‰ฝ๋„๋ก ๋ช…ํ™•ํ•˜๊ฒŒ ํ•ด์ค„ ํ•„์š”๊ฐ€ ์žˆ์„๊ฒƒ ๊ฐ™์•„์š”

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2019-03-15 แ„‹แ…ฉแ„’แ…ฎ 3 43 32
@AnnieHwang ์กฐ๊ธˆ์ „ ๋…ผ์˜ํ•œ ๋‚ด์šฉ ๋ฐ˜์˜ํ–ˆ์Šต๋‹ˆ๋‹ค. ํ™•์ธ ๋ถ€ํƒ๋“œ๋ฆฝ๋‹ˆ๋‹ค- @joohokim1

@minjung-cho @AnnieHwang

๋„ค ํ™•์ธํ–ˆ์Šต๋‹ˆ๋‹ค. ์•„์ฃผ ์ข‹์Šต๋‹ˆ๋‹ค~

@AnnieHwang ๋ณ€๊ฒฝ๋œ๋‚ด์šฉ ์ ์šฉํ•œ ๋””์ž์ธ ๊ณต์œ ๋“œ๋ฆฝ๋‹ˆ๋‹ค-
image
image

Closing as completed.

Was this page helpful?
0 / 5 - 0 ratings