Dotaz: proftp - strasne pomaly prenos malych souboru.

[anon123]

Kdyz se snazim uploadovat male soubory, tak je to strasne pomale 4KB/s

Kdyz uploaduji jeden velky soubor, tak prenos je 800KB/s.

Absolutne nevim kde hledat. Mam nastaveny passive FTP, porty jsou presmerovany, netstat ukazuje spojeni na portu 21 a take na vysokem portu.

Syslog ukazuje:

Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:21 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:31 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192 Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat() Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161 Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192

proftpd.conf
ServerName                      "Debian"
ServerType                      standalone
UseIPv6                         off
DeferWelcome                    off

MultilineRFC2228                on
DefaultServer                   on
ShowSymlinks                    on

DefaultRoot                     ~
IdentLookups off
UseReverseDNS off
ServerIdent on "FTP Server ready."

RequireValidShell               off

TimeoutNoTransfer               600
TimeoutStalled                  600
TimeoutIdle                     1200

DisplayLogin                    welcome.msg
DisplayFirstChdir               .message
ListOptions                     "-l"
DenyFilter                      \*.*/

# Uncomment this if you are using NIS or LDAP to retrieve passwords:
#PersistentPasswd               off

# Uncomment this if you would use TLS module:
#TLSEngine                      on

# Uncomment this if you would use quota module:
#Quotas                         on

# Uncomment this if you would use ratio module:
#Ratios                         on

# Port 21 is the standard FTP port.
Port                            21
PassivePorts 60000 60500

# To prevent DoS attacks, set the maximum number of child processes
# to 30.  If you need to allow more than 30 concurrent connections
# at once, simply increase this value.  Note that this ONLY works
# in standalone mode, in inetd mode you should use an inetd server
# that allows you to limit maximum number of processes per service
# (such as xinetd)
MaxInstances                    30

# Set the user and group that the server normally runs at.
User                            nobody
Group                           nogroup

# Umask 022 is a good standard umask to prevent new files and dirs
# (second parm) from being group and world writable.
Umask                           022     022
# Normally, we want files to be overwriteable.
AllowOverwrite                  on

# Delay engine reduces impact of the so-called Timing Attack described in
# http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02
# It is on by default.
DelayEngine                     off

 

Odpovědi

[anon123]

syslog se mi nepovedl tak znova.

Mar 10 06:27:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192
Mar 10 06:27:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192
Mar 10 06:28:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:28:21 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:28:31 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192
Mar 10 06:28:41 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - scrubbing scoreboard
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:131
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:133
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - ROOT PRIVS at mod_core.c:161
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - RELINQUISH PRIVS at mod_core.c:192
Mar 10 06:29:11 ns0 proftpd[18112]: ns0.xx.com - FS: using system lstat()

[pthv]

Pricin muze byt nekolik. Prvni sit nedokaze prenest dostatek packetu/s. Druha, ze to nezvladaji disky. I kdyz 4kb/s je zalostne malo. No a za treti chyba nekde v konfiguraci.

[anon123]

Ahoj.

Add 1.
Kdyz dokazu prenest jeden velky soubor 800KB/s (jak jsem psal), tak to sit asi dokaze.

Add 2.
Zase, kdyz prenasim soubor 800KB/s a disky to zvladaji, tak by to mely zvladat i pri prenosu vice souboru. Jinak disky to urcite zvladaji.

Add 3.
Dost mozny, ale kde?

No myslim, ze jsi si akorad nevsiml, ze jsem psal, ze upload jednoho velkeho souboru (400MB) frci jak po masle (800KB/s), ale jak vezmu adresar s malymi soubory, tak ta rychlost strasne klesne. Zajimalo by me jak je to mozny?

[NN]

Jestli na druhe strane neni limiter na pocet otevrenych FTP spojeni,

nebo skusit --set-tos 0x008, nebo trekovani. Dale jsen nasel toto

jako vhodnou volbu: IdentLookups off UseReverseDNS off

NN

 

 

[anon123]

Limiter to neni.

Prisel jsem na to a je to velice zajimave. Chyba je ve formatu proftpd.conf. Mrknete se na ten co jsem vlozil nahore. To je default konfigurak v debianu.

Pridal jsem sekci <Global> a naskladal do ni vse co jsem mel v tom konfiguraku. Restartoval jsem demona a ten mi vzdy rekl co do te "Global" sekce nepatri. Tim jsem vyradil par options, ktere tam asi nepatri. Zbylo mi to co vidite dole.

Kdyz to schrnu, tak to bylo tim, ze jsem nemel seckci "Global" a v ni nejake ty options, ktere tam patri.

ServerName                      "Debian"
ServerType                      standalone
DefaultServer                   on
UseIPv6                         off
DeferWelcome                    off
MultilineRFC2228                on
UseReverseDNS off

# Port 21 is the standard FTP port.
Port                            21

# To prevent DoS attacks, set the maximum number of child processes
# to 30.  If you need to allow more than 30 concurrent connections
# at once, simply increase this value.  Note that this ONLY works
# in standalone mode, in inetd mode you should use an inetd server
# that allows you to limit maximum number of processes per service
# (such as xinetd)
MaxInstances                    30

<Global>
ShowSymlinks                    on

DefaultRoot                     ~
IdentLookups off

ServerIdent on "FTP Server ready."

RequireValidShell               off

TimeoutNoTransfer               600
TimeoutStalled                  600
TimeoutIdle                     1200

DisplayLogin                    welcome.msg
DisplayFirstChdir               .message
ListOptions                     "-l"

DenyFilter                      \*.*/

# Uncomment this if you are using NIS or LDAP to retrieve passwords:
#PersistentPasswd               off

# Uncomment this if you would use TLS module:
#TLSEngine                      on

# Uncomment this if you would use quota module:
#Quotas                         on

# Uncomment this if you would use ratio module:
#Ratios                         on

# Use Passive ftp
PassivePorts 60000 60500

# Set the user and group that the server normally runs at.
User                            nobody
Group                           nogroup

# Umask 022 is a good standard umask to prevent new files and dirs

# (second parm) from being group and world writable.
Umask                           022     022

# Normally, we want files to be overwriteable.
AllowOverwrite                  on

# Delay engine reduces impact of the so-called Timing Attack described in
# http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02
# It is on by default.
DelayEngine                     off

# A basic anonymous configuration, no upload directories.

# <Anonymous ~ftp>
#   User                                ftp
#   Group                               nogroup
#   # We want clients to be able to login with "anonymous" as well as "ftp"
#   UserAlias                   anonymous ftp
#   # Cosmetic changes, all files belongs to ftp user
#   DirFakeUser on ftp
#   DirFakeGroup on ftp
#
#   RequireValidShell           off
#
#   # Limit the maximum number of anonymous logins
#   MaxClients                  10
#
#   # We want 'welcome.msg' displayed at login, and '.message' displayed
#   # in each newly chdired directory.
#   DisplayLogin                        welcome.msg
#   DisplayFirstChdir           .message
#
#   # Limit WRITE everywhere in the anonymous chroot
#   <Directory *>

#   RequireValidShell           off
#
#   # Limit the maximum number of anonymous logins
#   MaxClients                  10
#
#   # We want 'welcome.msg' displayed at login, and '.message' displayed
#   # in each newly chdired directory.
#   DisplayLogin                        welcome.msg
#   DisplayFirstChdir           .message
#
#   # Limit WRITE everywhere in the anonymous chroot
#   <Directory *>
#     <Limit WRITE>
#       DenyAll
#     </Limit>
#   </Directory>
#
#   # Uncomment this if you're brave.
#   # <Directory incoming>
#   #   # Umask 022 is a good standard umask to prevent new files and dirs
#   #   # (second parm) from being group and world writable.
#   #   Umask                           022  022
#   #            <Limit READ WRITE>
#   #            DenyAll
#   #            </Limit>
#   #            <Limit STOR>
#   #            AllowAll
#   #            </Limit>
#   # </Directory>
#
# </Anonymous>

</Global>

[anon123]

Jeste mala zmena:

PassivePorts patri ven z Global section. Tedy nahoru hned za Port.

Kdyby to admini opravili aby to bylo komplet a prehledne, tak by to bylo fajn.

[anon123]

Tak to beru zpet.

PassivePorts muzou byt v Global.

[anon123]

Tak jsem se predcasne unahlil. Spatne jsem testoval.

Rychlost je stale pomala.

FTP upload jedu pres LAN - router - FTPserver. Vse jede na 1G. To jen abychom isolovaly vse co by mohlo orezat rychlost. Zadne filtry, atd.

[Filip Jirsák]

Pro každý soubor se musí nejprve ustavit spojení, což je asi to, co nejvíce zdržuje. To může být zpomalené zkoušením IPv6 nebo resolvováním DNS. Napadá mne jediné řešení -- pustit tcpdump nebo WireShark a sledovat, kde to vázne.

[pthv]

K tomuhle bych akorat dodal, jestli mas vse na 1Gbit, tak prenos dat by nemel probihat 800kbyte/s ale 7-35Mbyte/s s tim, ze male soubory by meli jit pomaleji, ale zase ne 4kbyte/s. Zkus prenaset soubory primo mezi FTP serverem a notebookem nebo PC bez dalsich prvku. Tim se opravdu vyresi, jestli je to v siti nebo ne. Pri prenosu je dobre jeste sledovat vytizeni CPU jak na serveru, tak na tom PC, ze ktereho prenasis. Dale je dobre pouzit nejaky kvalitnejsi FTP klient. Napr. total commander pri urcitem nastaveni nedokaze prenest vic jak 500-800kbyte/s.

[pthv]

pouzitelny free klient je napriklad filezilla, ale jsou i dalsi.

[anon123]

Jasne, tech 800KB/s je spojeni pres WAN. Pres LAN mi to jede jak rikas, az 35MB/s. Ale jen jeden velky soubor. Male soubory proste nejedeou.

Pozivam ftp clienta v Linuxu (CLI). Take ftp v Dolphin v KDE4.

Fakt bych rekl, ze problem je zakopanej v Proftpd.

[cronin]

Kdyz se snazim uploadovat male soubory, tak je to strasne pomale 4KB/s

Kdyz uploaduji jeden velky soubor, tak prenos je 800KB/s.

AFAIK, je to takpoviediac "ficura" FTP protokolu. Kazdy prenos sa najskor dohodne cez kontrolne spojenie, potom sa pren urobi nove datove spojenie a cez to sa prenesu data. Takze zatial co prenos velkeho suboru cez FTP vytazi maximum z infrastruktury na ktorej bezi, tak prenos velkeho poctu suborov je stupidne neefektivny.

Skus najst, ci ProFTPd a zucastneny klient vedia robit nejaku formu "keep-alive" ci "pipeline" prenosu cez datovy kanal. Upozornujem, ze "strielam od boku" a netusim, ci nieco take je vobec cez FTP mozne.

[NN]

Pasivni FTP a rozsirit rozsah pasivnich portu?

jen napad,

NN

[anon123]

Tak snad je videt z konfiguraku, ze pouzivam passive port a ze mam 500 portu.

[Sejki]

Jen me napadla takova kravina, mas ty pasivni porty povoleny na firewallu?