From owner-freebsd-current@FreeBSD.ORG Mon Jul 5 00:31:12 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C665106564A; Mon, 5 Jul 2010 00:31:12 +0000 (UTC) (envelope-from aoyama@peach.ne.jp) Received: from moon.peach.ne.jp (unknown [IPv6:2001:380:e06:127::53]) by mx1.freebsd.org (Postfix) with ESMTP id D34EF8FC14; Mon, 5 Jul 2010 00:31:11 +0000 (UTC) Received: from moon.peach.ne.jp (localhost [127.0.0.1]) by moon.peach.ne.jp (Postfix) with ESMTP id 6BD2D78C3B; Mon, 5 Jul 2010 09:30:59 +0900 (JST) Received: from artemis (unknown [192.168.2.20]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by moon.peach.ne.jp (Postfix) with ESMTP id 54D2278C34; Mon, 5 Jul 2010 09:30:59 +0900 (JST) Message-ID: <1DD9F5F85C5248429027045C2A3693F0@ad.peach.ne.jp> From: "Daisuke Aoyama" To: "Alexander Motin" References: <6BC2B2FBAFFA4C26A46977F121B707E1@ad.peach.ne.jp> <4C2F4B67.3060201@FreeBSD.org> <10CB692CA3FE4A8992B250B7F35B243B@ad.peach.ne.jp> <4C30758E.7080102@FreeBSD.org> In-Reply-To: <4C30758E.7080102@FreeBSD.org> Date: Mon, 5 Jul 2010 09:30:11 +0900 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="ISO-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 14.0.8117.416 X-MimeOLE: Produced By Microsoft MimeOLE V14.0.8117.416 X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD-Current Subject: Re: [Need Help]isboot (iSCSI boot driver) version 0.2.1 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jul 2010 00:31:12 -0000 Thank you for your advice! > 128KB is a default MAXPHYS value. You may rise it in your kernel if you > want. I am successfully using 1MB MAXPHYS now. I misunderstood. I thought maxio was able to overwrite in GENERIC kernel. OK, I built custom kernel. There is a result. It's great! The log shows: client request 1 PDU(SCSI OP=0x28) with TL=1MB (2048 blocks). target response 4 PDUs with MRDSL=256KB (SCSI status is embedded in last BHS). --------------------------------------------------------------- iSCSI client: FreeBSD 8.1-RC2 amd64 + isboot 0.2.2 (maxio=1M) iSCSI target: FreeBSD 7.3 amd64 + istgt 20100606 (QueueDepth 64) Notes: both side use em(4) with MTU=1500. test.dat was created before rebooting. [root@fbs8-isboot /usr/tmp]# dd if=./test.dat of=/dev/null bs=1m count=1k 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 9.357166 secs (114750753 bytes/sec) [root@fbs8-isboot /usr/tmp]# dd if=/dev/zero of=./test0.dat bs=1m count=1k 1024+0 records in 1024+0 records out 1073741824 bytes transferred in 15.100469 secs (71106521 bytes/sec) /usr/src/sys/amd64/conf/GENERIC (added): options MAXPHYS=(1024*1024) /boot/loader.conf: isboot_load="YES" /etc/sysctl.conf: vfs.read_max=2048 kern.ipc.maxsockbuf=16777216 net.inet.tcp.sendbuf_max=16777216 net.inet.tcp.recvbuf_max=16777216 net.inet.tcp.sendbuf_auto=1 net.inet.tcp.sendbuf_inc=16384 net.inet.tcp.recvbuf_auto=1 net.inet.tcp.recvbuf_inc=524288 net.inet.tcp.inflight.enable=0 --------------------------------------------------------------- When enabling log at istgt (previous 16KB and queued 1MB read): istgt_iscsi.c: 430:istgt_iscsi_read_pdu: BHS read 48 istgt_iscsi.c: 242:istgt_iscsi_read: Read 48 bytes (no padding) istgt_iscsi.c:4870:worker: isid=804953420001, tsih=1, cid=1, op=1 istgt_iscsi.c:4352:istgt_iscsi_execute: opcode 1 CDB 28 00 02 c1 80 ff 00 08 (....... 00 00 00 00 00 00 00 00 ........ istgt_iscsi.c:2934:istgt_iscsi_op_scsi: I=0, F=1, R=1, W=0, Attr=1, ITT=3bf7, TL=1048576 istgt_iscsi.c:2939:istgt_iscsi_op_scsi: CmdSN=15350, ExpStatSN=15351, StatSN=15351, ExpCmdSN=15350, MaxCmdSN=15412 istgt_lu.c:2227:istgt_lu_execute: LU99: PG=0x0001, Name=iqn.2007-09.jp.ne.peach:isboot1, LUN=0x0002000000000000 istgt_lu_disk.c:4162:istgt_lu_disk_queue: Queue(0), CmdSN=15350, OP=0x28, LUN=0x0002000000000000 istgt_lu_disk.c:4175:istgt_lu_disk_queue: insert Simple istgt_iscsi.c:3088:istgt_iscsi_op_scsi: Queue OK istgt_iscsi.c:4890:worker: isid=804953420001, tsih=1, cid=1, op=1 complete istgt_iscsi.c:4760:worker: kevent sock 40 (timeout 20000ms) istgt_lu_disk.c:3540:istgt_lu_disk_lbread: Read 16384/16384 bytes istgt_lu_disk.c:5726:istgt_lu_disk_execute: SCSI OP=0x28, LUN=0x0002000000000000 status=0x0, complete istgt_iscsi.c:3219:istgt_iscsi_task_response: SCSI response CmdSN=15349 istgt_iscsi.c:2776:istgt_iscsi_transfer_in: Transfer 16384 istgt_iscsi.c:2811:istgt_iscsi_transfer_in: Transfer=16384, Offset=0, Len=16384 istgt_iscsi.c:2814:istgt_iscsi_transfer_in: StatSN=15351, DataSN=0, Offset=0, Len=16384 istgt_iscsi.c: 678:istgt_iscsi_write_pdu: BHS write 48 istgt_iscsi.c: 367:istgt_iscsi_write: Write 48 bytes (no padding) istgt_iscsi.c: 744:istgt_iscsi_write_pdu: Data write 16384 istgt_iscsi.c: 367:istgt_iscsi_write: Write 16384 bytes (no padding) istgt_iscsi.c:4760:worker: kevent sock 40 (timeout 20000ms) istgt_lu_disk.c:4510:istgt_lu_disk_queue_start: LU99: LUN2 queue end istgt_lu_disk.c:4250:istgt_lu_disk_queue_count: LU99: LUN2 queue(1) istgt_lu_disk.c:4284:istgt_lu_disk_queue_start: LU99: LUN2 queue start istgt_lu_disk.c:4480:istgt_lu_disk_queue_start: LU99: LUN2 Task Read Start istgt_lu_disk.c:4617:istgt_lu_disk_execute: SCSI OP=0x28, LUN=0x0002000000000000 istgt_lu_disk.c:5129:istgt_lu_disk_execute: READ_10(lba 46235903, len 2048 blocks) istgt_lu_disk.c:3514:istgt_lu_disk_lbread: Read: max=67108864, lba=46235903, len=2048 istgt_lu_disk.c:3540:istgt_lu_disk_lbread: Read 1048576/1048576 bytes istgt_lu_disk.c:5726:istgt_lu_disk_execute: SCSI OP=0x28, LUN=0x0002000000000000 status=0x0, complete istgt_lu_disk.c:4510:istgt_lu_disk_queue_start: LU99: LUN2 queue end istgt_iscsi.c:3219:istgt_iscsi_task_response: SCSI response CmdSN=15350 istgt_iscsi.c:2776:istgt_iscsi_transfer_in: Transfer 1048576 istgt_iscsi.c:2811:istgt_iscsi_transfer_in: Transfer=1048576, Offset=0, Len=262144 istgt_iscsi.c:2814:istgt_iscsi_transfer_in: StatSN=15352, DataSN=0, Offset=0, Len=262144 istgt_iscsi.c: 678:istgt_iscsi_write_pdu: BHS write 48 istgt_iscsi.c: 367:istgt_iscsi_write: Write 48 bytes (no padding) istgt_iscsi.c: 744:istgt_iscsi_write_pdu: Data write 262144 istgt_iscsi.c: 367:istgt_iscsi_write: Write 262144 bytes (no padding) istgt_iscsi.c:2811:istgt_iscsi_transfer_in: Transfer=1048576, Offset=262144, Len=262144 istgt_iscsi.c:2814:istgt_iscsi_transfer_in: StatSN=15352, DataSN=1, Offset=262144, Len=262144 istgt_iscsi.c: 678:istgt_iscsi_write_pdu: BHS write 48 istgt_iscsi.c: 367:istgt_iscsi_write: Write 48 bytes (no padding) istgt_iscsi.c: 744:istgt_iscsi_write_pdu: Data write 262144 istgt_iscsi.c: 367:istgt_iscsi_write: Write 262144 bytes (no padding) istgt_iscsi.c:2811:istgt_iscsi_transfer_in: Transfer=1048576, Offset=524288, Len=262144 istgt_iscsi.c:2814:istgt_iscsi_transfer_in: StatSN=15352, DataSN=2, Offset=524288, Len=262144 istgt_iscsi.c: 678:istgt_iscsi_write_pdu: BHS write 48 istgt_iscsi.c: 367:istgt_iscsi_write: Write 48 bytes (no padding) istgt_iscsi.c: 744:istgt_iscsi_write_pdu: Data write 262144 istgt_iscsi.c: 367:istgt_iscsi_write: Write 262144 bytes (no padding) istgt_iscsi.c:2811:istgt_iscsi_transfer_in: Transfer=1048576, Offset=786432, Len=262144 istgt_iscsi.c:2814:istgt_iscsi_transfer_in: StatSN=15352, DataSN=3, Offset=786432, Len=262144 istgt_iscsi.c: 678:istgt_iscsi_write_pdu: BHS write 48 istgt_iscsi.c: 367:istgt_iscsi_write: Write 48 bytes (no padding) istgt_iscsi.c: 744:istgt_iscsi_write_pdu: Data write 262144 istgt_iscsi.c: 367:istgt_iscsi_write: Write 262144 bytes (no padding) istgt_iscsi.c:4760:worker: kevent sock 40 (timeout 20000ms) --------------------------------------------------------------- -- Daisuke Aoyama