Created attachment 22660 [details] config.log for 12-13 Hi All, Compile of Slurm 21.08.4 fails on a Centos 7.9.2009 host; this is being built in /usr/local with a newly-built copy of hwloc-2.5 also in /usr/local. Slurm 20.11.6 builds on this machine just fine, also with hwloc-2.5. config.log for slurm 21.08.4 is attached.... Thanks! /bin/sh ../../../libtool --tag=CC --mode=link gcc -DNUMA_VERSION1_COMPATIBILITY -g -O2 -std=gnu99 -fno-omit-frame-pointer -pthread -ggdb3 -Wall -g -O1 -fno-strict-aliasing -export-dynamic -Wl,-rpath -Wl,/usr/local/lib64 -L/usr/local/lib64 -Wl,--no-as-needed -o slurmd slurmd.o req.o get_mach_stat.o ../../../src/bcast/libfile_bcast.la ../common/libslurmd_common.o -Wl,-rpath=/usr/local/lib/slurm -L../../../src/api/.libs -lslurmfull -ldl -lnuma -lhwloc -lpam -lpam_misc -lutil -lm -lresolv libtool: link: gcc -DNUMA_VERSION1_COMPATIBILITY -g -O2 -std=gnu99 -fno-omit-frame-pointer -pthread -ggdb3 -Wall -g -O1 -fno-strict-aliasing -Wl,-rpath -Wl,/usr/local/lib64 -Wl,--no-as-needed -o slurmd slurmd.o req.o get_mach_stat.o ../common/libslurmd_common.o -Wl,-rpath=/usr/local/lib/slurm -Wl,--export-dynamic -L/usr/local/lib64 ../../../src/bcast/.libs/libfile_bcast.a -L/usr/lib -llz4 -L../../../src/api/.libs -lslurmfull -ldl -lnuma /usr/local/lib/libhwloc.so -lpam -lpam_misc -lutil -lm -lresolv -pthread slurmd.o: In function `_read_config': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:918: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1054: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1073: undefined reference to `cgroup_memcg_job_confinement' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1075: undefined reference to `slurm_conf' slurmd.o: In function `_select_spec_cores': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2472: undefined reference to `slurm_conf' slurmd.o: In function `_core_spec_init': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2341: undefined reference to `slurm_conf' slurmd.o: In function `_memory_spec_init': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2421: undefined reference to `cgroup_memcg_job_confinement' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2422: undefined reference to `slurm_conf' slurmd.o: In function `_kill_old_slurmd': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2100: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2100: undefined reference to `read_pidfile' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2109: undefined reference to `slurm_conf' slurmd.o: In function `_fill_registration_msg': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:729: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:734: undefined reference to `gres_node_config_pack' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:813: undefined reference to `convert_old_step_id' slurmd.o: In function `run_script_health_check': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2596: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2596: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2601: undefined reference to `slurm_conf' slurmd.o: In function `main': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:267: undefined reference to `closeall' slurmd.o: In function `_slurmd_init': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1706: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1707: undefined reference to `gres_init' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1716: undefined reference to `cgroup_g_init' slurmd.o: In function `_print_gres': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1376: undefined reference to `gres_init_node_config' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1380: undefined reference to `gres_g_node_config_load' slurmd.o: In function `_slurmd_init': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1760: undefined reference to `gres_init_node_config' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1766: undefined reference to `gres_g_node_config_load' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1820: undefined reference to `rlimits_adjust_nofile' slurmd.o: In function `main': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:302: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:319: undefined reference to `xdaemon' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:322: undefined reference to `test_core_limit' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:360: undefined reference to `prep_g_init' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:375: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:375: undefined reference to `create_pidfile' slurmd.o: In function `_msg_engine': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:453: undefined reference to `slurm_conf' slurmd.o: In function `_reconfigure': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1112: undefined reference to `cgroup_conf_reinit' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1145: undefined reference to `gres_reconfig' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1148: undefined reference to `prep_g_reconfig' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1156: undefined reference to `gres_init_node_config' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1163: undefined reference to `gres_g_node_config_load' slurmd.o: In function `main': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:395: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:396: undefined reference to `slurm_conf' slurmd.o: In function `_slurmd_fini': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1911: undefined reference to `gres_fini' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1912: undefined reference to `prep_g_fini' /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1922: undefined reference to `cgroup_g_fini' slurmd.o: In function `main': /usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:297: undefined reference to `slurm_conf' req.o: In function `_slurm_authorized_user': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5420: undefined reference to `slurm_conf' req.o: In function `_run_prolog': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5602: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5608: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5614: undefined reference to `prep_g_prolog' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5622: undefined reference to `slurm_conf' req.o: In function `_rpc_reattach_tasks': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4332: undefined reference to `slurm_get_port' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4340: undefined reference to `slurm_set_port' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4350: undefined reference to `slurm_set_port' req.o: In function `_find_step_loc': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2790: undefined reference to `verify_step_id' req.o: In function `_run_epilog': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5647: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5652: undefined reference to `prep_g_epilog' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5655: undefined reference to `slurm_conf' req.o: In function `_sync_messages_kill': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5376: undefined reference to `slurm_conf' req.o: In function `_rpc_terminate_job': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5237: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5237: undefined reference to `spank_has_epilog' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5282: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5309: undefined reference to `gres_g_epilog_set_env' req.o: In function `_enforce_job_mem_limit': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2903: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2945: undefined reference to `slurm_conf' req.o: In function `_get_step_list': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:3436: undefined reference to `log_build_step_id_str' req.o: In function `_launch_job_fail': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2600: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2601: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2603: undefined reference to `slurm_conf' req.o: In function `_send_slurmstepd_init': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:465: undefined reference to `cgroup_write_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:518: undefined reference to `reverse_tree_info' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:571: undefined reference to `slurm_pack_addr' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:581: undefined reference to `slurm_pack_addr' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:625: undefined reference to `gres_g_send_stepd' req.o: In function `_rpc_batch_job': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2322: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2342: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2342: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2345: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2382: undefined reference to `gres_g_epilog_build_env' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2384: undefined reference to `gres_g_epilog_set_env' req.o: In function `_get_user_env': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1796: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1797: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1799: undefined reference to `slurm_conf' req.o: In function `_requeue_setup_env_fail': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6078: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6079: undefined reference to `slurm_conf' req.o:/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6081: more undefined references to `slurm_conf' follow req.o: In function `_set_batch_job_limits': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1842: undefined reference to `slurm_cred_get_mem' req.o: In function `_rpc_launch_tasks': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1392: undefined reference to `auth_g_get_gid' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1434: undefined reference to `slurm_get_port' req.o: In function `_check_job_credential': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1041: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1123: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1128: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1141: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1167: undefined reference to `slurm_cred_get_mem' req.o: In function `_rpc_launch_tasks': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1501: undefined reference to `gres_g_epilog_build_env' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1503: undefined reference to `gres_g_epilog_set_env' req.o: In function `_rpc_prolog': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2161: undefined reference to `slurm_conf' req.o: In function `_convert_job_mem': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1936: undefined reference to `slurm_cred_get_mem' req.o: In function `_rpc_prolog': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2175: undefined reference to `gres_g_epilog_set_env' /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2240: undefined reference to `slurm_conf' req.o: In function `_rpc_suspend_job': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4806: undefined reference to `slurm_conf' req.o: In function `_rpc_abort_job': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5060: undefined reference to `gres_g_epilog_set_env' req.o: In function `_rpc_file_bcast': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4046: undefined reference to `auth_g_get_gid' req.o: In function `_rpc_prolog': /usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2216: undefined reference to `slurm_conf' ../common/libslurmd_common.o: In function `job_container_init': /usr/local/slurm-21.08.4/src/slurmd/common/job_container_plugin.c:105: undefined reference to `slurm_conf' ../common/libslurmd_common.o: In function `slurm_proctrack_init': /usr/local/slurm-21.08.4/src/slurmd/common/proctrack.c:119: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/common/proctrack.c:123: undefined reference to `slurm_conf' ../common/libslurmd_common.o: In function `init_system_cpuset_cgroup': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:79: undefined reference to `cgroup_g_initialize' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:82: undefined reference to `cgroup_g_system_create' ../common/libslurmd_common.o: In function `init_system_memory_cgroup': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:87: undefined reference to `cgroup_g_initialize' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:90: undefined reference to `slurm_cgroup_conf' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:102: undefined reference to `slurm_cgroup_conf' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:106: undefined reference to `slurm_cgroup_conf' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:111: undefined reference to `slurm_cgroup_conf' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:113: undefined reference to `slurm_cgroup_conf' ../common/libslurmd_common.o:/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:115: more undefined references to `slurm_cgroup_conf' follow ../common/libslurmd_common.o: In function `init_system_memory_cgroup': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:155: undefined reference to `cgroup_g_system_create' ../common/libslurmd_common.o: In function `fini_system_cgroup': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:166: undefined reference to `cgroup_g_system_destroy' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:167: undefined reference to `cgroup_g_system_destroy' ../common/libslurmd_common.o: In function `set_system_cgroup_cpus': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:177: undefined reference to `cgroup_g_system_constrain_set' ../common/libslurmd_common.o: In function `set_system_cgroup_mem_limit': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:189: undefined reference to `cgroup_g_system_constrain_set' ../common/libslurmd_common.o: In function `attach_system_cpuset_pid': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:196: undefined reference to `cgroup_g_system_addto' ../common/libslurmd_common.o: In function `attach_system_memory_pid': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:201: undefined reference to `cgroup_g_system_addto' ../common/libslurmd_common.o: In function `check_corespec_cgroup_job_confinement': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:207: undefined reference to `slurm_cgroup_conf' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:208: undefined reference to `slurm_conf' ../common/libslurmd_common.o: In function `attach_system_cgroup_pid': /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:218: undefined reference to `cgroup_g_system_addto' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:222: undefined reference to `cgroup_memcg_job_confinement' /usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:224: undefined reference to `cgroup_g_system_addto' ../common/libslurmd_common.o: In function `slurmd_task_init': /usr/local/slurm-21.08.4/src/slurmd/common/task_plugin.c:122: undefined reference to `slurm_conf' ../common/libslurmd_common.o: In function `xcpuinfo_hwloc_topo_get': /usr/local/slurm-21.08.4/src/slurmd/common/xcpuinfo.c:324: undefined reference to `slurm_conf' /usr/local/slurm-21.08.4/src/slurmd/common/xcpuinfo.c:332: undefined reference to `slurm_conf' ../../../src/bcast/.libs/libfile_bcast.a(libfile_bcast_la-file_bcast.o): In function `_find_subpath': /usr/local/slurm-21.08.4/src/bcast/file_bcast.c:498: undefined reference to `subpath' ../../../src/bcast/.libs/libfile_bcast.a(libfile_bcast_la-file_bcast.o): In function `_get_job_info': /usr/local/slurm-21.08.4/src/bcast/file_bcast.c:144: undefined reference to `slurm_get_selected_step_id' collect2: error: ld returned 1 exit status make[4]: *** [slurmd] Error 1 make[4]: Leaving directory `/usr/local/slurm-21.08.4/src/slurmd/slurmd' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/usr/local/slurm-21.08.4/src/slurmd' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/slurm-21.08.4/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/slurm-21.08.4' make: *** [all] Error 2
Jeff this looks similar/same as bug#10679. I will have Marcin from our support team take a deeper look and let you know for sure.
Jeff, It looks like the issue is that the linker makes use of libslurmfull from Slurm 20.11. If I read that part correctly: >[...]-L/usr/lib -llz4 -L../../../src/api/.libs -lslurmfull It looks for the libslurmfull in /usr/lib, which I'm guessing is the location where you have previous version of Slurm installed? cheers, Marcin
Jeff, Please let me know if you need more help on that. In case of no reply, I'll close the bug report as information given. cheers, Marcin
Jeff, I'll go ahead and mark this case as resolved. If you have any questions please reopen. cheers, Marcin