Date: Fri, 10 Dec 2010 13:26:06 -0200 (ARST) From: Kevin Mai <kma@mrecic.gov.ar> To: linux-ha@lists.linux-ha.org Cc: freebsd-questions <freebsd-questions@freebsd.org> Subject: Issues when running Heartbeat on FreeBSD 8.1 RELEASE Message-ID: <1294039617.42493.1291994766801.JavaMail.root@mrelmx10.mrec.ar> In-Reply-To: <1416738542.42422.1291994310297.JavaMail.root@mrelmx10.mrec.ar>
next in thread | previous in thread | raw e-mail | index | archive | help
Hi folks,=20 I'm trying to build a failover solution using FreeBSD 8.1-RELEASE and Heart= beat from ports (v2.1.4-10).=20 I've already configured heartbeat in the two peers, but once I start the da= emon using the /usr/local/etc/rc.d/heartbeat script, either CRM and CIB fai= l to start.=20 I've already found out that the issue is appearing with CIB: when the daemo= n runs CIB it doesn't start, but if I run it using some flags, it starts, a= nd them I'm able to run CRM too.=20 IE:=20 heartbeat[12539]: 2010/12/10_14:22:14 info: Starting "/usr/local/lib/heartb= eat/cib" as uid 275 gid 275 (pid 12539)=20 heartbeat[12540]: 2010/12/10_14:22:14 info: Starting "/usr/local/lib/heartb= eat/attrd" as uid 275 gid 275 (pid 12540)=20 heartbeat[12482]: 2010/12/10_14:22:14 WARN: Managed /usr/local/lib/heartbea= t/cib process 12539 exited with return code 2.=20 heartbeat[12482]: 2010/12/10_14:22:14 ERROR: Client /usr/local/lib/heartbea= t/cib "respawning too fast"=20 heartbeat[12541]: 2010/12/10_14:22:14 info: Starting "/usr/local/lib/heartb= eat/crmd" as uid 275 gid 275 (pid 12541)=20 heartbeat[12482]: 2010/12/10_14:22:14 WARN: Managed /usr/local/lib/heartbea= t/attrd process 12540 exited with return code 2.=20 heartbeat[12482]: 2010/12/10_14:22:14 ERROR: Client /usr/local/lib/heartbea= t/attrd "respawning too fast"=20 heartbeat[12482]: 2010/12/10_14:22:14 WARN: Managed /usr/local/lib/heartbea= t/crmd process 12541 exited with return code 2.=20 heartbeat[12482]: 2010/12/10_14:22:14 ERROR: Client /usr/local/lib/heartbea= t/crmd "respawning too fast"=20 but if I run it from command line=20 [root@mrefns09 /usr/ports]# /usr/local/lib/heartbeat/cib -s -VVV &=20 cib[13338]: 2010/12/10_14:30:49 info: main: Retrieval of a per-action CIB: = disabled=20 cib[13338]: 2010/12/10_14:30:49 info: retrieveCib: Reading cluster configur= ation from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/= cib.xml.sig)=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: file2xml: Reading 3538 bytes= from file=20 cib[13338]: 2010/12/10_14:30:49 WARN: validate_cib_digest: No on-disk diges= t present=20 cib[13338]: 2010/12/10_14:30:49 debug: update_quorum: CCM quorum: old=3D(nu= ll), new=3Dfalse=20 cib[13338]: 2010/12/10_14:30:49 debug: update_counters: Counters updated by= readCibXmlFile=20 cib[13338]: 2010/12/10_14:30:49 notice: readCibXmlFile: Enabling DTD valida= tion on the existing (sane) configuration=20 cib[13338]: 2010/12/10_14:30:49 info: startCib: CIB Initialization complete= d successfully=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: init_server_ipc_comms: Liste= ning on: /var/run/heartbeat/crm/cib_callback=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: init_server_ipc_comms: Liste= ning on: /var/run/heartbeat/crm/cib_ro=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: init_server_ipc_comms: Liste= ning on: /var/run/heartbeat/crm/cib_rw=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: init_server_ipc_comms: Liste= ning on: /var/run/heartbeat/crm/cib_rw_syncronous=20 cib[13338]: 2010/12/10_14:30:49 debug: debug3: init_server_ipc_comms: Liste= ning on: /var/run/heartbeat/crm/cib_ro_syncronous=20 cib[13338]: 2010/12/10_14:30:49 info: cib_init: Starting cib mainloop=20 [root@mrefns09 /usr/local/lib/heartbeat]# /usr/local/lib/heartbeat/crmd -VV= V=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: main: Enabling coredumps=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : digraph "g" {=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : size =3D "30,30"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : graph [=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontsize =3D "12"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontname =3D "Times-Roman"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontcolor =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : bb =3D "0,0,398.922306,478.927856"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : color =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : node [=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontsize =3D "12"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontname =3D "Times-Roman"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontcolor =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : shape =3D "ellipse"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : color =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : edge [=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontsize =3D "12"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontname =3D "Times-Roman"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontcolor =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : color =3D "black"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : // special nodes=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_PENDING"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : [=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : color =3D "blue"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontcolor =3D "blue"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_TERMINATE"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : [=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : color =3D "red"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : fontcolor =3D "red"=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : // DC only nodes=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_INTEGRATION" [ fontcolor =3D "green" ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_POLICY_ENGINE" [ fontcolor =3D "green" ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_TRANSITION_ENGINE" [ fontcolor =3D "green" ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_RELEASE_DC" [ fontcolor =3D "green" ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: init_dotfile: actions:trace= : "S_IDLE" [ fontcolor =3D "green" ]=20 crmd[14877]: 2010/12/10_15:14:28 info: crmd_init: Starting crmd=20 crmd[14877]: 2010/12/10_15:14:28 debug: register_fsa_input_adv: crmd_init a= ppended FSA input 1 (I_STARTUP) (cause=3DC_STARTUP) without data=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: register_fsa_input_adv: Que= ue len: 1=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: FSA invoked wit= h Cause: C_STARTUP State: S_STARTING=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: Checking messag= es (1 remaining)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: get_message: Processing inp= ut 1=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: log_fsa_input: Processing q= ueued input 1=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: log_fsa_input: FSA processi= ng input from crmd_init=20 crmd[14877]: 2010/12/10_15:14:28 debug: s_crmd_fsa: Processing I_STARTUP: [= state=3DS_STARTING cause=3DC_STARTUP origin=3Dcrmd_init ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_LOG (1000000000000000)=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= LOG=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: do_log: [[FSA]] Input I_STA= RTUP from crmd_init() received in state (S_STARTING)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_LOG (1000000000000000)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: actions:trace: = // FSA input: State=3DS_STARTING Cause=3DC_STARTUP Input=3DI_STARTUP Origin= =3Dcrmd_init() id=3D1=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_STARTUP (0000000000000001)=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= STARTUP=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_startup: Registering Signal Hand= lers=20 crmd[14877]: 2010/12/10_15:14:28 info: G_main_add_SignalHandler: Added sign= al handler for signal 15=20 crmd[14877]: 2010/12/10_15:14:28 info: G_main_add_TriggerHandler: Added sig= nal manual handler=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_startup: Creating CIB and LRM ob= jects=20 crmd[14877]: 2010/12/10_15:14:28 info: G_main_add_SignalHandler: Added sign= al handler for signal 20=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_STARTUP (0000000000000001)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_CIB_START (0000020000000000)=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= CIB_START=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: init_client_ipc_comms_nodis= patch: Attempting to talk on: /var/run/heartbeat/crm/cib_rw=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: init_client_ipc_comms_nodis= patch: Processing of /var/run/heartbeat/crm/cib_rw complete=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: init_client_ipc_comms_nodis= patch: Attempting to talk on: /var/run/heartbeat/crm/cib_callback=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: init_client_ipc_comms_nodis= patch: Processing of /var/run/heartbeat/crm/cib_callback complete=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: init_client_ipc_comms: Addi= ng dispatch method to channel=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_client_connect_common: C= onnecting channel=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_client_connect_common: C= reated channel 0x802841958 for channel cib_rw=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_client_connect_common: C= hannel cib_rw connected for client (null)=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D=3D= =3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D#=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG: Dumping message with 3 fields= =20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[0] : [cib_op=3Dregister]=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[1] : [cib_clientid=3D4821470c-0a= ac-4bd6-9d5b-f4a15fdd063c]=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[2] : [cib_callback_token=3De87ce= ee6-3043-4c2d-b183-b3adeca43683]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D= =3D=3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D#=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: deb= ug3: cib_client_connect_common: Connecting channel=20 debug: MSG: Dumping message with 3 fields=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[0] : [cib_op=3Dregister]=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_client_connect_common: C= reated channel 0x802841dd8 for channel cib_callback=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[1] : [cib_callback_token=3De87c= eee6-3043-4c2d-b183-b3adeca43683]=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[2] : [cib_clientname=3Dcrmd]=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_client_connect_common: C= hannel cib_callback connected for client (null)=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_null_callback: Registere= d e87ceee6-3043-4c2d-b183-b3adeca43683 on cib_callback channel=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D=3D= =3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D#=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG: Dumping message with 2 fields= =20 crmd[14877]: 2010/12/10_15:14:28 debug: cib_native_signon: Connection to CI= B successful=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[0] : [cib_op=3Dregister]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: cib_native_set_connection_d= notify: Setting dnotify=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[1] : [cib_clientid=3De87ceee6-30= 43-4c2d-b183-b3adeca43683]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: cib_client_add_notify_callb= ack: Adding callback for cib_refresh_notify events (0)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D= =3D=3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D#=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG: Dumping message with 3 fields= =20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[0] : [cib_op=3Dcib_notify]=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 info: cib_= null_callback: Setting cib_refresh_notify callbacks for crmd: on=20 debug: MSG[1] : [cib_notify_type=3Dcib_refresh_notify]=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[2] : [cib_notify_activate=3D1]= =20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: cib_client_add_notify_callb= ack: Callback added (1)=20 crmd[14877]: 2010/12/10_15:14:28 info: do_cib_control: CIB connection estab= lished=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: cib_native_perform_op: Send= ing cib_query message to CIB service=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D= =3D=3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D#=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG: Dumping message with 5 fields= =20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[0] : [__name__=3Dcib_command]= =20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback: Callbac= k for 4821470c-0aac-4bd6-9d5b-f4a15fdd063c on cib_rw channel=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[1] : [t=3Dcib]=20 crmd[14877]: 2010/12/10_15:14:28 debug: MSG[2] : [cib_op=3Dcib_query]=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: deb= ug3: crm_log_message_adv: #=3D=3D=3D=3D=3D=3D=3D=3D=3D Client[inbound] mess= age start =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D#=20 debug: MSG[3] : [cib_callid=3D2]=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: MSG= : Dumping message with 5 fields=20 debug: MSG[4] : [cib_callopt=3D256]=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: MSG= [0] : [__name__=3Dcib_command]=20 debug: debug3: cib_native_perform_op: Message sent=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: MSG= [1] : [t=3Dcib]=20 debug: debug3: cib_native_perform_op: Async call, returning=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[2] : [cib_op=3Dcib_query]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_CIB_START (0000020000000000)=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[3] : [cib_callid=3D2]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_HA_CONNECT (0000000000000004)=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[4] : [cib_callopt=3D256]=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= HA_CONNECT=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback_worker: = Processing cib_query operation from -1/cib_rw=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: reg= ister_with_ha: Signing in with Heartbeat=20 debug: debug2: cib_process_request: Processing local message (localhost) fo= r master...=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: parse_local_options: Process= ing locally scoped cib_query op from -1=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_process_request: Finishe= d determining processing actions=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_request: Perform= ing local processing: op=3Dcib_query origin=3D(null)/4821470c-0aac-4bd6-9d5= b-f4a15fdd063c,2 (update=3D(null))=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_query: Processin= g "cib_query" event for section=3D<null>=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_request: Process= ing complete=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_process_request: process= ing response cases=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: do_local_notify: Performing = notification=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: do_local_notify: Sending cal= lback to request originator=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: do_local_notify: Sending an = a-sync response to -1=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: send_via_callback_channel: D= elivering msg 0x802895538 to client e87ceee6-3043-4c2d-b183-b3adeca43683=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: send_via_callback_channel: D= elivering reply to client e87ceee6-3043-4c2d-b183-b3adeca43683=20 crmd[14877]: 2010/12/10_15:14:28 ERROR: register_with_ha: Cannot sign on wi= th heartbeat:=20 crmd[14877]: 2010/12/10_15:14:28 debug: register_fsa_input_adv: register_fs= a_error_adv prepended FSA input 2 (I_NULL) (cause=3DC_STARTUP) without data= =20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: register_fsa_input_adv: Add= ing actions 0180001000000002 to input=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: register_fsa_input_adv: Pre= pending input=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: register_fsa_input_adv: Que= ue len: 1=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: register_fsa_input_adv: Tri= ggering FSA: register_fsa_input_adv=20 crmd[14877]: 2010/12/10_15:14:28 debug: register_fsa_input_adv: do_ha_contr= ol prepended FSA input 3 (I_FAIL) (cause=3DC_FSA_INTERNAL) without data=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: register_fsa_input_adv: Pre= pending input=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: register_fsa_input_adv: Que= ue len: 2=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: register_fsa_input_adv: Tri= ggering FSA: register_fsa_input_adv=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_HA_CONNECT (0000000000000004)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: Checking messag= es (2 remaining)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: get_message: Processing inp= ut 3=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: log_fsa_input: Processing q= ueued input 3=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: log_fsa_input: FSA processi= ng input from do_ha_control=20 crmd[14877]: 2010/12/10_15:14:28 debug: s_crmd_fsa: Processing I_FAIL: [ st= ate=3DS_STARTING cause=3DC_FSA_INTERNAL origin=3Ddo_ha_control ]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_WARN (4000000000000000)=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= WARN=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: crm_log_message_adv: #=3D=3D= =3D=3D=3D=3D=3D=3D=3D IPC[outbound] message start =3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D#=20 crmd[14877]: 2010/12/10_15:14:28 WARN: do_log: [[FSA]] Input I_FAIL from do= _ha_control() received in state (S_STARTING)=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG: Dumping message with 7 fields= =20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_WARN (4000000000000000)=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[0] : [t=3Dcib]=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: deb= ug2: do_state_transition: actions:trace: S_STARTING -> S_STOPPING [ label= =3DI_FAIL cause=3DC_FSA_INTERNAL origin=3Ddo_ha_control ]=20 debug: MSG[1] : [cib_clientid=3D4821470c-0aac-4bd6-9d5b-f4a15fdd063c]=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 info: do_s= tate_transition: State transition S_STARTING -> S_STOPPING [ input=3DI_FAIL= cause=3DC_FSA_INTERNAL origin=3Ddo_ha_control ]=20 debug: MSG[2] : [cib_callopt=3D256]=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: deb= ug2: crm_timer_stop: Election Timeout (I_ELECTION_DC:-1ms) already stopped= =20 debug: MSG[3] : [cib_callid=3D2]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: crm_timer_stop: PEngine Rec= heck Timer (I_PE_CALC:-1ms) already stopped=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[4] : [cib_op=3Dcib_query]=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: deb= ug3: fsa_dump_actions: Action 0000000000000200 (A_DC_TIMER_STOP) New action= s=20 debug: MSG[5] : [cib_rc=3D0]=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: fsa_dump_actions: Action 00= 00000000000020 (A_INTEGRATE_TIMER_STOP) New actions=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: fsa_dump_actions: Action 00= 00000000000080 (A_FINALIZE_TIMER_STOP) New actions=20 cib[14871]: 2010/12/10_15:14:28 debug: MSG[6] : [(2)cib_calldata=3D0x8028a6= 5f8(4108 5133)]=20 cib[14871]: 2010/12/10_15:14:28 debug: <cib admin_epoch=3D"0" epoch=3D"0" n= um_updates=3D"0" generated=3D"false" have_quorum=3D"false" ignore_dtd=3D"fa= lse">=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_DC_TIMER_STOP (0000000000000200)=20 cib[14871]: 2010/12/10_15:14:28 debug: <configuration>=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: do_= fsa_action: actions:trace: // A_DC_TIMER_STOP=20 debug: <crm_config>=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: deb= ug2: crm_timer_stop: Election Trigger (I_DC_TIMEOUT:-1ms) already stopped= =20 debug: <cluster_property_set id=3D"cib-bootstrap-options">=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_DC_TIMER_STOP (0000000000000200)=20 cib[14871]: 2010/12/10_15:14:28 debug: <attributes>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_INTEGRATE_TIMER_STOP (0000000000000020)=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= symmetric-cluster" name=3D"symmetric-cluster" value=3D"true"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= INTEGRATE_TIMER_STOP=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= no-quorum-policy" name=3D"no-quorum-policy" value=3D"stop"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: crm_timer_stop: Integration= Timer (I_INTEGRATED:-1ms) already stopped=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= default-resource-stickiness" name=3D"default-resource-stickiness" value=3D"= 0"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Action compl= ete: A_INTEGRATE_TIMER_STOP (0000000000000020)=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= default-resource-failure-stickiness" name=3D"default-resource-failure-stick= iness" value=3D"0"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: do_fsa_action: Invoking act= ion A_FINALIZE_TIMER_STOP (0000000000000080)=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= stonith-enabled" name=3D"stonith-enabled" value=3D"false"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: do_fsa_action: actions:trace: // A_= FINALIZE_TIMER_STOP=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= stonith-action" name=3D"stonith-action" value=3D"reboot"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: crm_timer_stop: Finalizatio= n Timer (I_ELECTION:-1ms) already stopped=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: <nv= pair id=3D"cib-bootstrap-options-startup-fencing" name=3D"startup-fencing" = value=3D"true"/>=20 debug: debug3: do_fsa_action: Action complete: A_FINALIZE_TIMER_STOP (00000= 00000000080)=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: <nv= pair id=3D"cib-bootstrap-options-stop-orphan-resources" name=3D"stop-orphan= -resources" value=3D"true"/>=20 debug: debug2: s_crmd_fsa: Checking messages (1 remaining)=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: get_message: Processing inp= ut 2=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= stop-orphan-actions" name=3D"stop-orphan-actions" value=3D"true"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: log_fsa_input: Processing q= ueued input 2=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= remove-after-stop" name=3D"remove-after-stop" value=3D"false"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: log_fsa_input: FSA processi= ng input from register_fsa_error_adv=20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: <nv= pair id=3D"cib-bootstrap-options-short-resource-names" name=3D"short-resour= ce-names" value=3D"true"/>=20 debug: debug3: fsa_dump_actions: Action 0080000000000000 (A_READCONFIG) Cle= ared Actions=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: deb= ug3: fsa_dump_actions: Action 0000000000000002 (A_STARTED) Cleared Actions= =20 debug: <nvpair id=3D"cib-bootstrap-options-transition-idle-timeout" name=3D= "transition-idle-timeout" value=3D"5min"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: fsa_dump_actions: Action 01= 00000000000000 (A_LRM_CONNECT) Cleared Actions=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= default-action-timeout" name=3D"default-action-timeout" value=3D"20s"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug3: fsa_dump_actions: Action 00= 00001000000000 (A_CCM_CONNECT) Cleared Actions=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= is-managed-default" name=3D"is-managed-default" value=3D"true"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: actions:trace: = // FSA input: State=3DS_STOPPING Cause=3DC_STARTUP Input=3DI_NULL Origin=3D= register_fsa_error_adv() id=3D2=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"cib-bootstrap-options-= cluster-delay" name=3D"cluster-delay" value=3D"60s"/>=20 crmd[14877]: 2010/12/10_15:14:28 debug: debug2: s_crmd_fsa: Exiting the FSA= =20 cib[14871]: 2010/12/10_15:14:28 crmd[14877]: 2010/12/10_15:14:28 debug: <nv= pair id=3D"cib-bootstrap-options-pe-error-series-max" name=3D"pe-error-seri= es-max" value=3D"-1"/>=20 debug: fsa_dump_inputs: Added input: 0000000000000004 (R_SHUTDOWN)=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 debug: <nv= pair id=3D"cib-bootstrap-options-pe-warn-series-max" name=3D"pe-warn-series= -max" value=3D"-1"/>=20 debug: fsa_dump_inputs: Added input: 0000000000000100 (R_CIB_CONNECTED)=20 crmd[14877]: 2010/12/10_15:14:28 cib[14871]: 2010/12/10_15:14:28 ERROR: crm= d_init: Startup of crmd failed. Current state: S_STOPPING=20 debug: <nvpair id=3D"cib-bootstrap-options-pe-input-series-max" name=3D"pe-= input-series-max" value=3D"-1"/>=20 crmd[14877]: 2010/12/10_15:14:28 info: crmd_init: [crmd] stopped (1)=20 cib[14871]: 2010/12/10_15:14:28 debug: </attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: </cluster_property_set>=20 cib[14871]: 2010/12/10_15:14:28 debug: </crm_config>=20 cib[14871]: 2010/12/10_15:14:28 debug: <nodes/>=20 cib[14871]: 2010/12/10_15:14:28 debug: <resources>=20 cib[14871]: 2010/12/10_15:14:28 debug: <group id=3D"group_1">=20 cib[14871]: 2010/12/10_15:14:28 debug: <primitive class=3D"ocf" id=3D"IPadd= r_200_16_97_6" provider=3D"heartbeat" type=3D"IPaddr">=20 cib[14871]: 2010/12/10_15:14:28 debug: <operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: <op id=3D"IPaddr_200_16_97_6_mon" in= terval=3D"5s" name=3D"monitor" timeout=3D"5s"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: <instance_attributes id=3D"IPaddr_20= 0_16_97_6_inst_attr">=20 cib[14871]: 2010/12/10_15:14:28 debug: <attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"IPaddr_200_16_97_6_att= r_0" name=3D"ip" value=3D"200.16.97.6"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: </instance_attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: </primitive>=20 cib[14871]: 2010/12/10_15:14:28 debug: <primitive class=3D"ocf" id=3D"IPadd= r_200_16_98_6" provider=3D"heartbeat" type=3D"IPaddr">=20 cib[14871]: 2010/12/10_15:14:28 debug: <operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: <op id=3D"IPaddr_200_16_98_6_mon" in= terval=3D"5s" name=3D"monitor" timeout=3D"5s"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: <instance_attributes id=3D"IPaddr_20= 0_16_98_6_inst_attr">=20 cib[14871]: 2010/12/10_15:14:28 debug: <attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: <nvpair id=3D"IPaddr_200_16_98_6_att= r_0" name=3D"ip" value=3D"200.16.98.6"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: </instance_attributes>=20 cib[14871]: 2010/12/10_15:14:28 debug: </primitive>=20 cib[14871]: 2010/12/10_15:14:28 debug: <primitive class=3D"heartbeat" id=3D= "jail_3" provider=3D"heartbeat" type=3D"jail">=20 cib[14871]: 2010/12/10_15:14:28 debug: <operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: <op id=3D"jail_3_mon" interval=3D"12= 0s" name=3D"monitor" timeout=3D"60s"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </operations>=20 cib[14871]: 2010/12/10_15:14:28 debug: </primitive>=20 cib[14871]: 2010/12/10_15:14:28 debug: </group>=20 cib[14871]: 2010/12/10_15:14:28 debug: </resources>=20 cib[14871]: 2010/12/10_15:14:28 debug: <constraints>=20 cib[14871]: 2010/12/10_15:14:28 debug: <rsc_location id=3D"rsc_location_gro= up_1" rsc=3D"group_1">=20 cib[14871]: 2010/12/10_15:14:28 debug: <rule id=3D"prefered_location_group_= 1" score=3D"100">=20 cib[14871]: 2010/12/10_15:14:28 debug: <expression attribute=3D"#uname" id= =3D"prefered_location_group_1_expr" operation=3D"eq" value=3D"mrefns09.mrec= .ar"/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </rule>=20 cib[14871]: 2010/12/10_15:14:28 debug: </rsc_location>=20 cib[14871]: 2010/12/10_15:14:28 debug: </constraints>=20 cib[14871]: 2010/12/10_15:14:28 debug: </configuration>=20 cib[14871]: 2010/12/10_15:14:28 debug: <status/>=20 cib[14871]: 2010/12/10_15:14:28 debug: </cib>=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_request: Complet= ed slave update=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback: Process= ed 1 messages=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback: Callbac= k for 4821470c-0aac-4bd6-9d5b-f4a15fdd063c on cib_rw channel=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback: Process= ed 0 messages=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_common_callback: Client = disconnected=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_disconnect: Clea= ning up after client disconnect: -1/cib_rw/4821470c-0aac-4bd6-9d5b-f4a15fdd= 063c=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_ipc_connection_destroy: = Destroying -1 (0x802841958)=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_ipc_connection_destroy: = Num unfree'd clients: 1=20 [root@mrefns09 /usr/local/lib/heartbeat]# cib[14871]: 2010/12/10_15:14:28 d= ebug: debug2: cib_null_callback: Client disconnected=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_process_disconnect: Clea= ning up after client disconnect: crmd/cib_callback/e87ceee6-3043-4c2d-b183-= b3adeca43683=20 cib[14871]: 2010/12/10_15:14:28 debug: debug3: cib_ipc_connection_destroy: = Destroying crmd (0x802841dd8)=20 cib[14871]: 2010/12/10_15:14:28 debug: debug2: cib_ipc_connection_destroy: = Num unfree'd clients: 0=20 If I'm not mistaken, running as root allos CIB/CRMD to speak through socket= , but if they are run through the rc script, they can't, even though the so= cket has=20 [root@mrefns09 /var/run/heartbeat/crm]# ls -lrtah=20 total 4=20 srwxrwxrwx 1 hacluster haclient 0B Dec 10 15:13 cib_rw_syncronous=20 srwxrwxrwx 1 hacluster haclient 0B Dec 10 15:13 cib_rw=20 srwxrwxrwx 1 hacluster haclient 0B Dec 10 15:13 cib_ro_syncronous=20 srwxrwxrwx 1 hacluster haclient 0B Dec 10 15:13 cib_ro=20 srwxrwxrwx 1 hacluster haclient 0B Dec 10 15:13 cib_callback=20 drwxr-x--- 2 hacluster haclient 512B Dec 10 15:13 .=20 drwxr-xr-x 6 hacluster haclient 512B Dec 10 15:21 ..=20 Since both processes are started by the heartbeat binary, it's not an optio= n to change the rc script to run both binaries by hand..=20 Any suggestions?=20 Kind Regards,=20 Kevin Mai=20 Direcci=C3=B3n de Tecnolog=C3=ADas de la Informaci=C3=B3n=20 y las Comunicaciones Asociadas=20 Ministerio de Relaciones Exteriores, Comercio Internacional y Culto=20 Esmeralda 1212 Piso 3=20 Tel: +54 011 5555-8900 (int. 3077)=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1294039617.42493.1291994766801.JavaMail.root>