Date: Sun, 04 May 2008 21:40:29 +0300 From: Oleksandr Samoylyk <oleksandr@samoylyk.sumy.ua> To: freebsd-net@freebsd.org Subject: Re: Troubles with em on FreeBSD 7 Message-ID: <481E031D.40300@samoylyk.sumy.ua> In-Reply-To: <481DC00E.6050705@samoylyk.sumy.ua> References: <912a71490805031516p3c35f419o62d614fc1649c48d@mail.gmail.com> <3c0b01820805031551m5444d986y9f51f67264643874@mail.gmail.com> <481CF009.4050606@samoylyk.sumy.ua> <481D9D13.1040505@samoylyk.sumy.ua> <481DBEA7.3050309@moneybookers.com> <481DC00E.6050705@samoylyk.sumy.ua>
next in thread | previous in thread | raw e-mail | index | archive | help
Moreover, here is a result of profiling:
granularity: each sample hit covers 16 byte(s) for 0.00% of 221.50 seconds
called/total parents
index %time self descendents called+self name index
called/total children
<spontaneous>
[1] 68.5 0.00 151.71 taskqueue_thread_loop [1]
0.02 145.30 1391229/1391229 taskqueue_run [2]
0.03 6.37 1391229/1391229 msleep_spin [39]
-----------------------------------------------
0.02 145.30 1391229/1391229
taskqueue_thread_loop [1]
[2] 65.6 0.02 145.30 1391229 taskqueue_run [2]
0.16 143.27 1395192/1395192 em_handle_rxtx [3]
0.00 0.96 1395192/1412690 wakeup [119]
0.91 0.00 1395192/93426961 spinlock_exit
<cycle 8> [12]
0.00 0.00 1395192/39782518 spinlock_enter [173]
0.00 0.00 3/93426961 _mtx_lock_spin
<cycle 8> [933]
-----------------------------------------------
0.16 143.27 1395192/1395192 taskqueue_run [2]
[3] 64.8 0.16 143.27 1395192 em_handle_rxtx [3]
1.00 136.80 1395192/1395192 em_rxeof [4]
0.35 4.74 1395192/1398898 em_txeof [50]
0.30 0.02 12711/749987 _mtx_lock_sleep [21]
0.03 0.00 1395192/1395192 em_enable_intr [333]
0.02 0.01 72300/4819861 em_start_locked [109]
0.00 0.01 2175/1395706 taskqueue_enqueue [47]
0.00 0.00 7/176995 _mtx_unlock_sleep
[114]
-----------------------------------------------
1.00 136.80 1395192/1395192 em_handle_rxtx [3]
[4] 62.2 1.00 136.80 1395192 em_rxeof [4]
0.68 133.48 3338526/3338526 ether_input [5]
0.14 2.50 3338526/3338526 em_get_buf [79]
-----------------------------------------------
0.68 133.48 3338526/3338526 em_rxeof [4]
[5] 60.6 0.68 133.48 3338526 ether_input [5]
0.10 132.73 3338526/3338526 ether_demux [6]
0.15 0.36 3338526/3338700 random_harvest [142]
0.13 0.00 3338526/8161034 bcmp [165]
-----------------------------------------------
0.10 132.73 3338526/3338526 ether_input [5]
[6] 60.0 0.10 132.73 3338526 ether_demux [6]
0.18 132.50 3338526/3338526 netisr_dispatch [7]
0.04 0.00 3338526/9831758 m_adj [216]
0.02 0.00 3336226/3336226 ip_fastforward [345]
-----------------------------------------------
0.18 132.50 3338526/3338526 ether_demux [6]
[7] 59.9 0.18 132.50 3338526 netisr_dispatch [7]
0.89 131.60 4859336/4860183 ip_input [8]
0.00 0.01 2300/2300 arpintr [486]
-----------------------------------------------
0.00 0.02 847/4860183
netisr_processqueue [343]
0.89 131.60 4859336/4860183 netisr_dispatch [7]
[8] 59.8 0.89 131.62 4860183 ip_input [8]
0.13 110.45 1642617/1642617 encap4_input [9]
0.42 17.79 3192274/3192274 ip_forward [22]
0.12 2.55 4860142/11299824 pfil_run_hooks [43]
0.01 0.08 8736/8736 tcp_input [224]
0.00 0.05 2331/2331 icmp_input [272]
0.00 0.01 20490/20490 ip_reass [381]
0.00 0.00 897/897 udp_input [692]
0.00 0.00 16/16 igmp_input [833]
0.00 0.00 41/8214484 m_freem [34]
0.00 0.00 22/6451824 in_cksum_skip [163]
-----------------------------------------------
0.13 110.45 1642617/1642617 ip_input [8]
[9] 49.9 0.13 110.45 1642617 encap4_input [9]
93.07 17.27 1642617/1643247 rip_input [10]
0.11 0.00 3285234/40183056 generic_bzero [113]
0.01 0.00 3285234/40183057 bzero [219]
-----------------------------------------------
0.00 0.00 16/1643247 igmp_input [833]
0.03 0.01 614/1643247 icmp_input [272]
93.07 17.27 1642617/1643247 encap4_input [9]
[10] 49.8 93.10 17.27 1643247 rip_input [10]
14.26 0.88 600796/749987 _mtx_lock_sleep [21]
0.16 1.70 1643863/1643863 raw_append [93]
0.00 0.24 36345/176995 _mtx_unlock_sleep
[114]
0.01 0.00 1643863/5117962 jailed [278]
0.00 0.00 1292/1843 m_copym [666]
0.00 0.00 676/8214484 m_freem [34]
-----------------------------------------------
[11] 27.5 60.76 0.11 93426961+50755313 <cycle 8 as a whole> [11]
60.29 0.00 39782516 spinlock_exit
<cycle 8> [12]
0.23 0.10 14907668
_thread_lock_flags <cycle 8> [164]
0.23 0.00 80459841 critical_exit
<cycle 8> [180]
0.00 0.02 4486040 sched_switch
<cycle 8> [380]
0.00 0.00 59579 _mtx_lock_spin
<cycle 8> [933]
0.00 0.00 295 thread_zombie
<cycle 8> [1331]
0.00 0.00 4486040 mi_switch <cycle
8> [1415]
0.00 0.00 295 thread_stash
<cycle 8> [1661]
-----------------------------------------------
295 thread_zombie
<cycle 8> [1331]
52826 _mtx_lock_spin
<cycle 8> [933]
149280 _thread_lock_flags
<cycle 8> [164]
1197932 critical_exit
<cycle 8> [180]
2676133 sched_switch
<cycle 8> [380]
0.00 0.00 1/93426961 pmap_growkernel
[1317]
0.00 0.00 3/93426961
smp_targeted_tlb_shootdown [1329]
0.00 0.00 4/93426961 kern_setitimer [1259]
0.00 0.00 6/93426961 kern_setrlimit [1064]
0.00 0.00 6/93426961 donice [1216]
0.00 0.00 6/93426961 sched_nice [1250]
0.00 0.00 7/93426961 thread_find [1294]
0.00 0.00 24/93426961
sc_draw_cursor_image [1195]
0.00 0.00 24/93426961 sc_puts [1173]
0.00 0.00 26/93426961 signotify [539]
0.00 0.00 30/93426961
turnstile_adjust_thread [1177]
0.00 0.00 47/93426961 pmap_pinit [1021]
0.00 0.00 70/93426961 thread_reap [568]
0.00 0.00 174/93426961
ioapic_enable_source [1017]
0.00 0.00 174/93426961
ioapic_disable_source [1016]
0.00 0.00 216/93426961 sched_balance [657]
0.00 0.00 272/93426961 calcru [555]
0.00 0.00 295/93426961 kse_unlink [976]
0.00 0.00 384/93426961 sleepq_switch [72]
0.00 0.00 565/93426961
sigqueue_delete_set_proc [928]
0.00 0.00 596/93426961 sleepq_remove [686]
0.00 0.00 607/93426961 doselwakeup [199]
0.00 0.00 1833/93426961 exec_setregs [634]
0.00 0.00 1986/93426961 create_thread [463]
0.00 0.00 2088/93426961 pcireg_cfgread [810]
0.00 0.00 2324/93426961 thread_wait [464]
0.00 0.00 2344/93426961 exit1 [209]
0.00 0.00 2344/93426961 cpu_exit [733]
0.00 0.00 2394/93426961 cpu_fork [687]
0.00 0.00 2405/93426961 tdsignal [591]
0.00 0.00 2639/93426961 sched_exit_thread
[579]
0.00 0.00 2749/93426961 kern_select [428]
0.00 0.00 2934/93426961 thread_exit [436]
0.00 0.00 3054/93426961 fork_exit [530]
0.00 0.00 3066/93426961 upcall_reap [681]
0.00 0.00 3219/93426961 poll [341]
0.00 0.00 3454/93426961 random_kthread [150]
0.00 0.00 3456/93426961 lim_cb [541]
0.00 0.00 3940/93426961 turnstile_cancel
[647]
0.00 0.00 4834/93426961 sleepq_wait_sig [362]
0.00 0.00 5050/93426961 scrn_update [583]
0.00 0.00 5384/93426961 ast [434]
0.00 0.00 5680/93426961
_callout_stop_safe [566]
0.00 0.00 6964/93426961 tdq_unlock_pair [540]
0.00 0.00 7182/93426961 fork1 [156]
0.00 0.00 7367/93426961 timeout [422]
0.01 0.00 8948/93426961
umtx_thread_cleanup [458]
0.01 0.00 9827/93426961 sleepq_timedwait
[339]
0.01 0.00 10820/93426961 sysctl_kern_proc
[185]
0.01 0.00 10921/93426961 sysctl_out_proc [190]
0.01 0.00 15008/93426961 sleepq_broadcast
[120]
0.01 0.00 18153/93426961 smp_tlb_shootdown
[403]
0.01 0.00 21842/93426961
fill_kinfo_proc_only [238]
0.02 0.00 26890/93426961 kern_wait [255]
0.02 0.00 34153/93426961 fill_kinfo_thread
[223]
0.02 0.00 34153/93426961 rufetch [273]
0.02 0.00 34153/93426961 sched_pctcpu [275]
0.03 0.00 41180/93426961 sched_relinquish
[232]
0.04 0.00 57525/93426961 statclock [234]
0.05 0.00 73748/93426961 ithread_loop [13]
0.10 0.00 156611/93426961 tdq_move [186]
0.11 0.00 176584/93426961
turnstile_chain_unlock [213]
0.11 0.00 176584/93426961
turnstile_broadcast [212]
0.14 0.00 216250/93426961 hardclock [133]
0.24 0.00 368000/93426961
propagate_priority [158]
0.27 0.00 419794/93426961
ipi_bitmap_handler [126]
0.28 0.00 432517/93426961 hardclock_cpu [136]
0.29 0.00 442303/93426961
random_harvest_internal [161]
0.36 0.00 551720/93426961 turnstile_wait [117]
0.38 0.00 578026/93426961 sched_idletd [130]
0.46 0.00 713661/93426961 turnstile_unpend
[121]
0.65 0.00 1002645/93426961
sleepq_timedwait_sig [58]
0.66 0.00 1007663/93426961 _sleep [36]
0.66 0.00 1009514/93426961 sched_userret [108]
0.66 0.00 1011766/93426961 sleepq_timeout [80]
0.75 0.00 1154115/93426961 callout_reset [128]
0.80 0.00 1223669/93426961 softclock [55]
0.90 0.00 1391229/93426961 msleep_spin [39]
0.90 0.00 1391229/93426961 sleepq_signal [64]
0.91 0.00 1395192/93426961 taskqueue_run [2]
0.91 0.00 1395706/93426961 taskqueue_enqueue
[47]
0.91 0.00 1401314/93426961 sleepq_wait [62]
1.31 0.00 2015712/93426961
sleepq_catch_signals [67]
1.55 0.00 2391125/93426961
intr_event_schedule_thread [70]
1.57 0.00 2419000/93426961 sleepq_add [73]
1.69 0.00 2602529/93426961 thread_lock_set [99]
1.74 0.00 2678939/93426961
thread_lock_unblock [97]
1.74 0.00 2678939/93426961 thread_lock_block
[96]
1.83 0.00 2814166/93426961 sleepq_release [95]
[12] 27.2 60.29 0.00 39782516 spinlock_exit <cycle
8> [12]
39782516 critical_exit
<cycle 8> [180]
-----------------------------------------------
<spontaneous>
[13] 13.2 0.02 29.15 ithread_loop [13]
0.00 24.78 2565/2565 swi_net [18]
0.04 4.19 79840/79840 softclock [55]
0.05 0.00 73748/93426961 spinlock_exit
<cycle 8> [12]
0.05 0.00 73746/93426961
_thread_lock_flags <cycle 8> [164]
0.05 0.00 73604/93426961 mi_switch <cycle
8> [1415]
0.00 0.00 348/348 ata_generic_intr [595]
0.00 0.00 174/174
ioapic_enable_source [1017]
-----------------------------------------------
[14] 12.7 1.79 26.30 42212703+24208605 <cycle 7 as a whole> [14]
0.73 13.40 19134629 uma_zalloc_arg
<cycle 7> [23]
0.61 12.53 19122186 uma_zfree_arg
<cycle 7> [25]
0.11 0.00 9765739 mb_dtor_mbuf
<cycle 7> [217]
0.03 0.05 233015 pmap_enter <cycle
7> [229]
0.08 0.00 11540146
m_tag_delete_chain <cycle 7> [236]
0.02 0.04 48306 free <cycle 7> [252]
0.02 0.03 3336409 mb_dtor_pack
<cycle 7> [257]
0.02 0.03 26102 vm_map_delete
<cycle 7> [258]
0.04 0.01 377027
vm_object_deallocate <cycle 7> [262]
0.00 0.04 48083 malloc <cycle 7> [267]
0.02 0.02 20817
vm_object_backing_scan <cycle 7> [281]
0.00 0.04 41572 vm_map_insert
<cycle 7> [283]
0.02 0.02 200903 vm_page_free_toq
<cycle 7> [305]
0.00 0.02 143645 pmap_remove <cycle
7> [366]
0.01 0.01 364837 vm_page_remove
<cycle 7> [378]
0.02 0.00 106608 pmap_remove_entry
<cycle 7> [390]
0.01 0.01 36267
vm_object_terminate <cycle 7> [393]
0.00 0.01 163934 vm_page_rename
<cycle 7> [396]
0.00 0.01 47009 vm_object_allocate
<cycle 7> [401]
0.01 0.00 108872 vm_object_collapse
<cycle 7> [408]
0.01 0.00 116035 vrele <cycle 7> [439]
0.01 0.00 290643 vdropl <cycle 7> [494]
0.00 0.00 21555 getblk <cycle 7> [517]
0.00 0.00 15381 _vm_map_clip_start
<cycle 7> [526]
0.00 0.00 39920
vm_map_simplify_entry <cycle 7> [528]
0.00 0.00 42476 vinactive <cycle
7> [538]
0.00 0.00 13881 vm_object_coalesce
<cycle 7> [543]
0.00 0.00 17436
vm_object_page_remove <cycle 7> [559]
0.00 0.00 1666 kmem_malloc <cycle
7> [560]
0.00 0.00 247351 v_decr_usecount
<cycle 7> [601]
0.00 0.00 9529 _vm_map_clip_end
<cycle 7> [602]
0.00 0.00 106608 free_pv_entry
<cycle 7> [608]
0.00 0.00 147290
vm_map_entry_create <cycle 7> [614]
0.00 0.00 975 ffs_update <cycle
7> [641]
0.00 0.00 23941 pmap_remove_pte
<cycle 7> [689]
0.00 0.00 41733 ufs_inactive
<cycle 7> [702]
0.00 0.00 145534
vm_map_entry_dispose <cycle 7> [753]
0.00 0.00 42476 VOP_INACTIVE_APV
<cycle 7> [754]
0.00 0.00 1066 inodedep_lookup
<cycle 7> [756]
0.00 0.00 165 bufwrite <cycle 7>
[799]
0.00 0.00 365 free_unr <cycle 7>
[847]
0.00 0.00 6332 vm_map_remove
<cycle 7> [873]
0.00 0.00 742 alloc_unr <cycle
7> [879]
0.00 0.00 742 thread_ctor <cycle
7> [897]
0.00 0.00 420 thread_init <cycle
7> [946]
0.00 0.00 73 allocbuf <cycle 7>
[967]
0.00 0.00 297 thread_dtor <cycle
7> [972]
0.00 0.00 686 brelse <cycle 7> [986]
0.00 0.00 168 g_vfs_strategy
<cycle 7> [993]
0.00 0.00 1622 slab_zalloc <cycle
7> [1051]
0.00 0.00 80 proc_init <cycle
7> [1070]
0.00 0.00 8 bufobj_invalbuf
<cycle 7> [1075]
0.00 0.00 50 getnewbuf <cycle
7> [1176]
0.00 0.00 6
softdep_setup_freeblocks <cycle 7> [1190]
0.00 0.00 87
softdep_disk_io_initiation <cycle 7> [1204]
0.00 0.00 9 vfs_vmio_release
<cycle 7> [1227]
0.00 0.00 89 ffs_bufwrite
<cycle 7> [1257]
0.00 0.00 1248
uma_zalloc_internal <cycle 7> [1356]
0.00 0.00 22 flushbuflist
<cycle 7> [1358]
0.00 0.00 184453 vm_page_free
<cycle 7> [1448]
0.00 0.00 8542 bread <cycle 7> [1508]
0.00 0.00 8542 breadn <cycle 7>
[1510]
0.00 0.00 3076 uma_zone_slab
<cycle 7> [1554]
0.00 0.00 2176 mb_zinit_pack
<cycle 7> [1572]
0.00 0.00 1666 page_alloc <cycle
7> [1587]
0.00 0.00 1150 clean_unrhdrl
<cycle 7> [1591]
0.00 0.00 945
softdep_update_inodeblock <cycle 7> [1601]
0.00 0.00 733 vdrop <cycle 7> [1609]
0.00 0.00 677 m_tag_delete
<cycle 7> [1612]
0.00 0.00 677 m_tag_free_default
<cycle 7> [1613]
0.00 0.00 651
vnode_pager_setsize <cycle 7> [1618]
0.00 0.00 420 umtx_thread_init
<cycle 7> [1641]
0.00 0.00 420 umtxq_alloc <cycle
7> [1642]
0.00 0.00 420 sleepq_alloc
<cycle 7> [1639]
0.00 0.00 420 turnstile_alloc
<cycle 7> [1640]
0.00 0.00 373 kmem_free <cycle
7> [1651]
0.00 0.00 168 ffs_geom_strategy
<cycle 7> [1684]
0.00 0.00 168 g_alloc_bio <cycle
7> [1685]
0.00 0.00 105 workitem_free
<cycle 7> [1694]
0.00 0.00 80 pstats_alloc
<cycle 7> [1706]
0.00 0.00 76 uma_large_free
<cycle 7> [1712]
0.00 0.00 76 page_free <cycle
7> [1710]
0.00 0.00 76 bufstrategy <cycle
7> [1709]
0.00 0.00 76 VOP_STRATEGY_APV
<cycle 7> [1708]
0.00 0.00 76 ufs_strategy
<cycle 7> [1711]
0.00 0.00 48 bucket_alloc
<cycle 7> [1729]
0.00 0.00 44 uma_large_malloc
<cycle 7> [1735]
0.00 0.00 33
handle_allocdirect_partdone <cycle 7> [1746]
0.00 0.00 31 free_inodedep
<cycle 7> [1748]
0.00 0.00 28 brelvp <cycle 7>
[1755]
0.00 0.00 19 geteblk <cycle 7>
[1788]
0.00 0.00 17
softdep_change_linkcnt <cycle 7> [1792]
0.00 0.00 8 vinvalbuf <cycle
7> [1816]
0.00 0.00 7 free_allocdirect
<cycle 7> [1817]
0.00 0.00 6 ffs_truncate
<cycle 7> [1822]
0.00 0.00 2
vnode_destroy_vobject <cycle 7> [1846]
0.00 0.00 2
softdep_releasefile <cycle 7> [1843]
0.00 0.00 1 vrecycle <cycle 7>
[1866]
0.00 0.00 1 vgonel <cycle 7>
[1863]
0.00 0.00 1 VOP_RECLAIM_APV
<cycle 7> [1847]
0.00 0.00 1 ufs_reclaim <cycle
7> [1861]
0.00 0.00 1 ffs_ifree <cycle
7> [1854]
0.00 0.00 1 ffs_vfree <cycle
7> [1855]
0.00 0.00 1 softdep_freefile
<cycle 7> [1858]
0.00 0.00 1 startup_alloc
<cycle 7> [1859]
-----------------------------------------------
--
Oleksandr Samoylyk
OVS-RIPE
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?481E031D.40300>