IT Talks 106

๋ฐ์ดํ„ฐ ์ง๋ฌด๋ณ„ ์Šคํ‚ฌ - Types of Data Professionals

์ „์— ๋ฐ์ดํ„ฐ ์ง๋ฌด๋ณ„ ํ•˜๋Š”์ผ์— ๋Œ€ํ•œ ํฌ์ŠคํŒ…์„ ์˜ฌ๋ฆฐ ์ ์ด ์žˆ์—ˆ๋Š”๋ฐ (์•„๋ž˜ ๊ธ€ ์ฐธ๊ณ ) ์ด๋ฒˆ์—๋Š” ๊ฐ ๋ฐ์ดํ„ฐ ์ง๋ฌด๋ณ„ ์ฃผ์š” ์—…๋ฌด์— ๋Œ€ํ•ด ์ฐจํŠธ ํ˜•ํƒœ๋กœ ๋œ ๊ทธ๋ฆผ์ด ์žˆ์–ด์„œ ๊ณต์œ ํ•ด ๋ณธ๋‹ค. Data Scientist vs Engineer vs Analyst ์˜ˆ์ „์— ์ธํ„ฐ๋„ท์—์„œ ๋ดค๋˜ ์ด๋ฏธ์ง€ ์ธ๋ฐ, ๋ฐ์ดํ„ฐ ๊ด€๋ จ ์ง๋ฌด์— ๋Œ€ํ•ด ์ •๋ฆฌ๊ฐ€ ์ž˜ ์•ˆ๋˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์•„์„œ ์ฐธ๊ณ ํ•˜๋ฉด ์ข‹์„ ๊ฒƒ ๊ฐ™๋‹ค. (ํ˜„์‹ค์€ ๊ทธ๋ ‡์ง€ ์•Š์ง€๋งŒ) Data Scientist ํ†ต๊ณ„๋‚˜ ๋จธ์‹  ๋Ÿฌ๋‹์„ ์ด์šฉํ•ด ์ฃผ์š” ๋น„ blog.ojj.kr

IT Talks/BigData 2023.08.02

[MySQL] INT ์ž๋ฃŒํ˜• (TINYINT / SMALLINT / MEDIUMINT / INT / BIGINT)

๋งค๋ฒˆ ๊ฒ€์ƒ‰ํ•˜๊ธฐ ๊ท€์ฐฎ์•„์„œ ํผ์˜ด ใ…Žใ…Ž Table 11.1 Required Storage and Range for Integer Types Supported by MySQL Type Storage (Bytes) ์ตœ์†Œ๊ฐ’ (signed) ์ตœ์†Œ๊ฐ’ (unsigned) ์ตœ๋Œ€๊ฐ’ (signed) ์ตœ๋Œ€๊ฐ’ (unsigned) TINYINT 1 -128 0 127 255 SMALLINT 2 -32768 0 32767 65535 MEDIUMINTINT 3 -8388608 0 8388607 16777215 INT 4 -2147483648 0 2147483647 4294967295 BIGINT 8 -2^63 0 2^63 - 1 2^64 - 1 * ์ถœ์ฒ˜ : https://dev.mysql.com/doc/refman/8.0/en/int..

IT Talks/Database 2023.07.23

How To Install Jenkins on Ubuntu 22.04

Jenkins ์„ค์น˜ ๊ด€๋ จํ•ด์„œ ๊ฒ€์ƒ‰์„ ํ•˜๋‹ค๋ณด๋ฉด ์ด๋Ÿฐ์ €๋Ÿฐ ๊ธ€๋“ค์ด ๋งŽ์€๋ฐ ์„ค์น˜ ํ•˜๋‹ค ๋ณด๋ฉด GPG error ๋„ ์ข…์ข… ๋ฐœ์ƒํ•˜๊ณ  ์ด๋Ÿฐ ์ €๋Ÿฐ ์˜ค๋ฅ˜๊ฐ€ ๋‚˜์˜ค๋Š” ๊ฒฝ์šฐ๊ฐ€ ์žˆ๋Š”๋ฐ ๊ณต์‹ ํ™ˆํŽ˜์ด์ง€์— ์žˆ๋Š” ๊ฐ€์ด๋“œ ๋Œ€๋กœ ๋”ฐ๋ผํ•˜๋ฉด ๋ฌธ์ œ ์—†์ด ์„ค์น˜๊ฐ€ ๋˜๋Š” ๊ฒƒ ๊ฐ™๋‹ค. * ์ถœ์ฒ˜ : https://pkg.origin.jenkins.io/debian-stable/ ์•„๋ž˜ ์ฝ”๋“œ๋ฅผ ์‰ด์—์„œ ์ˆœ์„œ๋Œ€๋กœ ์‹คํ–‰ curl -fsSL https://pkg.jenkins.io/debian-stable/jenkins.io-2023.key | sudo tee \ /usr/share/keyrings/jenkins-keyring.asc > /dev/null echo deb [signed-by=/usr/share/keyrings/jenkins-keyring.asc] \..

IT Talks/Linux 2023.05.23

git subtree - repository ๋‚ด์— ๋‹ค๋ฅธ repository link ํ•˜๊ธฐ

Github ๋“ฑ์—์„œ git ์„ ํ†ตํ•ด ์ฝ”๋“œ๋ฅผ ๊ด€๋ฆฌํ•˜๋‹ค ๋ณด๋ฉด ์—ฌ๋Ÿฌ repo ์— ์ค‘๋ณต๋˜๋Š” ์ฝ”๋“œ๊ฐ€ ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋Ÿฐ repo ๊ฐ„ ์ฝ”๋“œ ์ค‘๋ณต์„ ํ”ผํ•˜๊ธฐ ์œ„ํ•ด ํŠน์ • repo ์•ˆ์— ๋‹ค๋ฅธ repo ๋ฅผ ์—ฐ๊ฒฐํ•ด์„œ ์‚ฌ์šฉํ•˜๋ฉด ์ค‘๋ณต์„ ํ”ผํ•  ์ˆ˜ ์žˆ๋Š”๋ฐ, git subtree ๋ฅผ ํ™œ์šฉํ•˜๋ฉด ๊ฐ€๋Šฅํ•˜๋‹ค. (๋ฆฌ๋ˆ…์Šค์—์„œ์˜ symbloic link ์™€ ๋น„์Šทํ•˜๋‹ค๊ณ  ํ•ด์•ผํ• ๊นŒ?) - ๋ฉ”์ธ repo : mysite - ์„œ๋ธŒ repo : utils (์—ฐ๊ฒฐํ•  repo) ๋ฉ”์ธ repo ์˜ ์ตœ์ƒ์œ„ ํด๋”์—์„œ ์•„๋ž˜ ๋ช…๋ น์„ ์ˆœ์„œ๋Œ€๋กœ ์‹คํ–‰ 1. remote ์— ์—ฐ๊ฒฐํ•  repo ๋“ฑ๋ก $ git remote add [remote ์ด๋ฆ„] [์—ฐ๊ฒฐํ•  repo ์ฃผ์†Œ] $ git remote add utils https://github.com/okojj/utils.git..

IT Talks 2023.03.22

Pandas Data Frame vs Spark DataFrame

DataFrame ์€ ํ–‰๊ณผ ์—ด์ด ์žˆ๋Š” ๋ฐ์ดํ„ฐ ํ…Œ์ด๋ธ”์„ ๋‚˜ํƒ€๋‚ด๋ฉฐ, DataFrame ๊ฐœ๋…์€ ์–ด๋–ค ํ”„๋กœ๊ทธ๋ž˜๋ฐ ์–ธ์–ด์—์„œ๋„ ๋ณ€ํ•˜์ง€ ์•Š์ง€๋งŒ Spark ์™€ Pandas ์˜ DataFrame ์€ ์ƒ๋‹นํžˆ ๋‹ค๋ฅด๋‹ค. ์ด ๊ธ€์—์„œ๋Š” Spark DataFrame๊ณผ Pandas DataFra,e์˜ ์ฐจ์ด์ ์„ ์•Œ์•„๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. Pandas DataFrame Panda๋Š” NumPy ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜๋Š” ์˜คํ”ˆ ์†Œ์Šค Python ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ๋‹ค์–‘ํ•œ ๋ฐ์ดํ„ฐ ๊ตฌ์กฐ์™€ ์—ฐ์‚ฐ์„ ์‚ฌ์šฉํ•˜์—ฌ ์ˆ˜์น˜ ๋ฐ์ดํ„ฐ์™€ ์‹œ๊ณ„์—ด์„ ์กฐ์ž‘ํ•  ์ˆ˜ ์žˆ๋Š” Python ํŒจํ‚ค์ง€์ž…๋‹ˆ๋‹ค. ์ฃผ๋กœ ๋ฐ์ดํ„ฐ ๊ฐ€์ ธ์˜ค๊ธฐ ๋ฐ ๋ถ„์„์„ ์ƒ๋‹นํžˆ ์‰ฝ๊ฒŒ ํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. Panda DataFrame์€ ๋ ˆ์ด๋ธ”์ด ์ง€์ •๋œ ์ถ•(ํ–‰ ๋ฐ ์—ด)์„ ๊ฐ€์ง„ ์ž ์žฌ์ ์œผ๋กœ ์ด์งˆ์ ์ธ 2์ฐจ์› ํฌ๊ธฐ ๊ฐ€๋ณ€ ํ‘œ ํ˜•์‹ ..

IT Talks/BigData 2023.03.16

์•ฑ์—์„œ ์ ‘์†ํ•˜๋Š” URL ํ™•์ธํ•˜๊ธฐ

ChatGPT ์—๊ฒŒ ๋ฌผ์–ด๋ดค๋‹ค. Q) How can I capture the API URL of smartphone application ? A) To capture the API URL of a smartphone application, you will need to use a tool called a network sniffer or packet capture tool. This type of tool intercepts and captures the network traffic between your smartphone and the application's server, allowing you to inspect the requests and responses that are sent and rec..

IT Talks/AI 2023.03.03

์„œ๋ฒ„์˜ ๊ณต์ธ IP ํ™•์ธํ•˜๊ธฐ

์ผ๋ฐ˜์ ์ธ ๋ฆฌ๋ˆ…์Šค ์„œ๋ฒ„๋Š” ์ด๋”๋„ท๋ณ„๋กœ IP๋ฅผ ํ• ๋‹นํ•˜์—ฌ ifconfig ๋ช…๋ น์–ด๋กœ ํ• ๋‹น๋œ IP ๋ฅผ ํ™•์ธํ•  ์ˆ˜ ์žˆ์œผ๋‚˜ AWS (Amazon Web Service)๋“ฑ์˜ ํด๋ผ์šฐ๋“œ ์žฅ๋น„์—์„œ๋Š” Private IP ๋งŒ ํ™•์ธ์ด ๊ฐ€๋Šฅํ•˜๊ณ  Public IP ๋Š” Amazon Console ๋“ฑ์„ ํ†ตํ•ด์„œ ํ™•์ธ์ด ๊ฐ€๋Šฅํ•˜๋‹ค.๋˜๋Š” NAT ์•„๋ž˜์— ์œ„์น˜ํ•œ ์„œ๋ฒ„๋“ค์˜ ๊ฒฝ์šฐ๋„ ์‹ค์ œ ํ• ๋‹น๋œ IP๋Š” ์‚ฌ์„ค IP๋งŒ ํ‘œ์‹œ๋˜๊ณ , ์™ธ๋ถ€ ์ ‘์†์‹œ ์™ธ๋ถ€ ์„œ๋ฒ„์—์„œ ์ธ์‹ํ•˜๋Š” IP ๋Š” NAT ์˜ IP ๊ฐ€ ๋œ๋‹ค.์ด๋Ÿฐ ๊ฒฝ์šฐ ์„œ๋ฒ„์—์„œ ๊ฐ„๋‹จํ•˜๊ฒŒ ์™ธ๋ถ€๋กœ ์ ‘์†ํ•˜๋Š” ๋ณธ์ธ IP๋ฅผ ํ™•์ธํ•˜๋Š” ๋ฐฉ๋ฒ•์€ ์•„๋ž˜์™€ ๊ฐ™๋‹ค.1. ํ˜„์žฌ ์‚ฌ์šฉ์ค‘์ธ ์„œ๋ฒ„์˜ ๊ณต์ธIP ์กฐํšŒ (Outbound)$ curl ip.ojj.krYour IP is 175.123.191.3 2. ํŠน์ • IP์˜ ์ •๋ณด ์กฐํšŒ$ curl ip...

IT Talks/Linux 2023.02.22

[๋ฆฌ๋ˆ…์Šค] date ๋ช…๋ น์œผ๋กœ timestamp ๋ณ€ํ™˜ํ•˜๊ธฐ

1. timestamp ๊ฐ’์œผ๋กœ ์›ํ•˜๋Š” ๋‚ ์งœ ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ $ date -d '1970-01-01 1676360315 sec' 2023. 02. 14. (ํ™”) 07:38:35 KST $ date -d '1970-01-01 1676360315 sec' +'%Y-%m-%d %H:%M:%S' 2023-02-14 07:38:35 * ๊ฒฐ๊ณผ๋Š” ์‹œ์Šคํ…œ Timezone์— ๋งž์ถฐ์„œ ํ‘œ์‹œ๋จ 2. ๋‚ ์งœ ํ˜•์‹์œผ๋กœ timestamp ๊ฐ’ ๊ตฌํ•˜๊ธฐ (1๋ฒˆ๊ณผ ๋ฐ˜๋Œ€) $ date -d '2022-02-14' +%s 1644764400

IT Talks 2023.02.14

ChatGPT ๊ฐ€ ์ถ”์ฒœํ•˜๋Š” ๊ฐœ๋ฐœ์ž ์ปค๋ฆฌ์–ด

Q. Please recommend a career as a software developer. A. A career as a software developer can be a very rewarding and fulfilling choice. Here are some reasons why: 1. High demand: Software development is a rapidly growing field with a high demand for skilled professionals. This means that there are many job opportunities available and the demand for software developers is expected to continue to..

IT Talks/AI 2023.02.13
728x90