Ticket 13027

Summary: build failure on 21.08.4
Product: Slurm Reporter: Jeff Avila <geoffrey_avila>
Component: Build System and PackagingAssignee: Marcin Stolarek <cinek>
Status: RESOLVED INFOGIVEN QA Contact:
Severity: 3 - Medium Impact    
Priority: ---    
Version: 21.08.4   
Hardware: Linux   
OS: Linux   
Site: Brown Univ Alineos Sites: ---
Atos/Eviden Sites: --- Confidential Site: ---
Coreweave sites: --- Cray Sites: ---
DS9 clusters: --- HPCnow Sites: ---
HPE Sites: --- IBM Sites: ---
NOAA SIte: --- OCF Sites: ---
Recursion Pharma Sites: --- SFW Sites: ---
SNIC sites: --- Linux Distro: ---
Machine Name: CLE Version:
Version Fixed: Target Release: ---
DevPrio: --- Emory-Cloud Sites: ---
Attachments: config.log for 12-13

Description Jeff Avila 2021-12-13 18:23:19 MST
Created attachment 22660 [details]
config.log for 12-13

Hi All,

Compile of Slurm 21.08.4 fails on a Centos 7.9.2009 host; this is being built in /usr/local with a newly-built copy of hwloc-2.5 also in /usr/local. Slurm 20.11.6 builds on this machine just fine, also with hwloc-2.5.

config.log for slurm 21.08.4 is attached....

Thanks!


/bin/sh ../../../libtool  --tag=CC   --mode=link gcc  -DNUMA_VERSION1_COMPATIBILITY -g -O2 -std=gnu99 -fno-omit-frame-pointer -pthread -ggdb3 -Wall -g -O1 -fno-strict-aliasing -export-dynamic  -Wl,-rpath -Wl,/usr/local/lib64 -L/usr/local/lib64 -Wl,--no-as-needed  -o slurmd slurmd.o req.o get_mach_stat.o ../../../src/bcast/libfile_bcast.la ../common/libslurmd_common.o -Wl,-rpath=/usr/local/lib/slurm -L../../../src/api/.libs -lslurmfull -ldl -lnuma -lhwloc -lpam -lpam_misc -lutil -lm -lresolv
libtool: link: gcc -DNUMA_VERSION1_COMPATIBILITY -g -O2 -std=gnu99 -fno-omit-frame-pointer -pthread -ggdb3 -Wall -g -O1 -fno-strict-aliasing -Wl,-rpath -Wl,/usr/local/lib64 -Wl,--no-as-needed -o slurmd slurmd.o req.o get_mach_stat.o ../common/libslurmd_common.o -Wl,-rpath=/usr/local/lib/slurm -Wl,--export-dynamic  -L/usr/local/lib64 ../../../src/bcast/.libs/libfile_bcast.a -L/usr/lib -llz4 -L../../../src/api/.libs -lslurmfull -ldl -lnuma /usr/local/lib/libhwloc.so -lpam -lpam_misc -lutil -lm -lresolv -pthread
slurmd.o: In function `_read_config':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:918: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1054: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1073: undefined reference to `cgroup_memcg_job_confinement'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1075: undefined reference to `slurm_conf'
slurmd.o: In function `_select_spec_cores':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2472: undefined reference to `slurm_conf'
slurmd.o: In function `_core_spec_init':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2341: undefined reference to `slurm_conf'
slurmd.o: In function `_memory_spec_init':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2421: undefined reference to `cgroup_memcg_job_confinement'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2422: undefined reference to `slurm_conf'
slurmd.o: In function `_kill_old_slurmd':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2100: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2100: undefined reference to `read_pidfile'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2109: undefined reference to `slurm_conf'
slurmd.o: In function `_fill_registration_msg':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:729: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:734: undefined reference to `gres_node_config_pack'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:813: undefined reference to `convert_old_step_id'
slurmd.o: In function `run_script_health_check':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2596: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2596: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:2601: undefined reference to `slurm_conf'
slurmd.o: In function `main':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:267: undefined reference to `closeall'
slurmd.o: In function `_slurmd_init':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1706: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1707: undefined reference to `gres_init'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1716: undefined reference to `cgroup_g_init'
slurmd.o: In function `_print_gres':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1376: undefined reference to `gres_init_node_config'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1380: undefined reference to `gres_g_node_config_load'
slurmd.o: In function `_slurmd_init':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1760: undefined reference to `gres_init_node_config'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1766: undefined reference to `gres_g_node_config_load'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1820: undefined reference to `rlimits_adjust_nofile'
slurmd.o: In function `main':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:302: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:319: undefined reference to `xdaemon'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:322: undefined reference to `test_core_limit'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:360: undefined reference to `prep_g_init'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:375: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:375: undefined reference to `create_pidfile'
slurmd.o: In function `_msg_engine':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:453: undefined reference to `slurm_conf'
slurmd.o: In function `_reconfigure':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1112: undefined reference to `cgroup_conf_reinit'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1145: undefined reference to `gres_reconfig'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1148: undefined reference to `prep_g_reconfig'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1156: undefined reference to `gres_init_node_config'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1163: undefined reference to `gres_g_node_config_load'
slurmd.o: In function `main':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:395: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:396: undefined reference to `slurm_conf'
slurmd.o: In function `_slurmd_fini':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1911: undefined reference to `gres_fini'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1912: undefined reference to `prep_g_fini'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:1922: undefined reference to `cgroup_g_fini'
slurmd.o: In function `main':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/slurmd.c:297: undefined reference to `slurm_conf'
req.o: In function `_slurm_authorized_user':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5420: undefined reference to `slurm_conf'
req.o: In function `_run_prolog':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5602: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5608: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5614: undefined reference to `prep_g_prolog'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5622: undefined reference to `slurm_conf'
req.o: In function `_rpc_reattach_tasks':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4332: undefined reference to `slurm_get_port'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4340: undefined reference to `slurm_set_port'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4350: undefined reference to `slurm_set_port'
req.o: In function `_find_step_loc':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2790: undefined reference to `verify_step_id'
req.o: In function `_run_epilog':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5647: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5652: undefined reference to `prep_g_epilog'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5655: undefined reference to `slurm_conf'
req.o: In function `_sync_messages_kill':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5376: undefined reference to `slurm_conf'
req.o: In function `_rpc_terminate_job':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5237: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5237: undefined reference to `spank_has_epilog'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5282: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5309: undefined reference to `gres_g_epilog_set_env'
req.o: In function `_enforce_job_mem_limit':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2903: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2945: undefined reference to `slurm_conf'
req.o: In function `_get_step_list':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:3436: undefined reference to `log_build_step_id_str'
req.o: In function `_launch_job_fail':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2600: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2601: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2603: undefined reference to `slurm_conf'
req.o: In function `_send_slurmstepd_init':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:465: undefined reference to `cgroup_write_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:518: undefined reference to `reverse_tree_info'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:571: undefined reference to `slurm_pack_addr'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:581: undefined reference to `slurm_pack_addr'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:625: undefined reference to `gres_g_send_stepd'
req.o: In function `_rpc_batch_job':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2322: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2342: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2342: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2345: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2382: undefined reference to `gres_g_epilog_build_env'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2384: undefined reference to `gres_g_epilog_set_env'
req.o: In function `_get_user_env':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1796: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1797: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1799: undefined reference to `slurm_conf'
req.o: In function `_requeue_setup_env_fail':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6078: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6079: undefined reference to `slurm_conf'
req.o:/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:6081: more undefined references to `slurm_conf' follow
req.o: In function `_set_batch_job_limits':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1842: undefined reference to `slurm_cred_get_mem'
req.o: In function `_rpc_launch_tasks':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1392: undefined reference to `auth_g_get_gid'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1434: undefined reference to `slurm_get_port'
req.o: In function `_check_job_credential':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1041: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1123: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1128: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1141: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1167: undefined reference to `slurm_cred_get_mem'
req.o: In function `_rpc_launch_tasks':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1501: undefined reference to `gres_g_epilog_build_env'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1503: undefined reference to `gres_g_epilog_set_env'
req.o: In function `_rpc_prolog':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2161: undefined reference to `slurm_conf'
req.o: In function `_convert_job_mem':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:1936: undefined reference to `slurm_cred_get_mem'
req.o: In function `_rpc_prolog':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2175: undefined reference to `gres_g_epilog_set_env'
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2240: undefined reference to `slurm_conf'
req.o: In function `_rpc_suspend_job':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4806: undefined reference to `slurm_conf'
req.o: In function `_rpc_abort_job':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:5060: undefined reference to `gres_g_epilog_set_env'
req.o: In function `_rpc_file_bcast':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:4046: undefined reference to `auth_g_get_gid'
req.o: In function `_rpc_prolog':
/usr/local/slurm-21.08.4/src/slurmd/slurmd/req.c:2216: undefined reference to `slurm_conf'
../common/libslurmd_common.o: In function `job_container_init':
/usr/local/slurm-21.08.4/src/slurmd/common/job_container_plugin.c:105: undefined reference to `slurm_conf'
../common/libslurmd_common.o: In function `slurm_proctrack_init':
/usr/local/slurm-21.08.4/src/slurmd/common/proctrack.c:119: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/proctrack.c:123: undefined reference to `slurm_conf'
../common/libslurmd_common.o: In function `init_system_cpuset_cgroup':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:79: undefined reference to `cgroup_g_initialize'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:82: undefined reference to `cgroup_g_system_create'
../common/libslurmd_common.o: In function `init_system_memory_cgroup':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:87: undefined reference to `cgroup_g_initialize'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:90: undefined reference to `slurm_cgroup_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:102: undefined reference to `slurm_cgroup_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:106: undefined reference to `slurm_cgroup_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:111: undefined reference to `slurm_cgroup_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:113: undefined reference to `slurm_cgroup_conf'
../common/libslurmd_common.o:/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:115: more undefined references to `slurm_cgroup_conf' follow
../common/libslurmd_common.o: In function `init_system_memory_cgroup':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:155: undefined reference to `cgroup_g_system_create'
../common/libslurmd_common.o: In function `fini_system_cgroup':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:166: undefined reference to `cgroup_g_system_destroy'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:167: undefined reference to `cgroup_g_system_destroy'
../common/libslurmd_common.o: In function `set_system_cgroup_cpus':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:177: undefined reference to `cgroup_g_system_constrain_set'
../common/libslurmd_common.o: In function `set_system_cgroup_mem_limit':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:189: undefined reference to `cgroup_g_system_constrain_set'
../common/libslurmd_common.o: In function `attach_system_cpuset_pid':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:196: undefined reference to `cgroup_g_system_addto'
../common/libslurmd_common.o: In function `attach_system_memory_pid':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:201: undefined reference to `cgroup_g_system_addto'
../common/libslurmd_common.o: In function `check_corespec_cgroup_job_confinement':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:207: undefined reference to `slurm_cgroup_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:208: undefined reference to `slurm_conf'
../common/libslurmd_common.o: In function `attach_system_cgroup_pid':
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:218: undefined reference to `cgroup_g_system_addto'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:222: undefined reference to `cgroup_memcg_job_confinement'
/usr/local/slurm-21.08.4/src/slurmd/common/slurmd_cgroup.c:224: undefined reference to `cgroup_g_system_addto'
../common/libslurmd_common.o: In function `slurmd_task_init':
/usr/local/slurm-21.08.4/src/slurmd/common/task_plugin.c:122: undefined reference to `slurm_conf'
../common/libslurmd_common.o: In function `xcpuinfo_hwloc_topo_get':
/usr/local/slurm-21.08.4/src/slurmd/common/xcpuinfo.c:324: undefined reference to `slurm_conf'
/usr/local/slurm-21.08.4/src/slurmd/common/xcpuinfo.c:332: undefined reference to `slurm_conf'
../../../src/bcast/.libs/libfile_bcast.a(libfile_bcast_la-file_bcast.o): In function `_find_subpath':
/usr/local/slurm-21.08.4/src/bcast/file_bcast.c:498: undefined reference to `subpath'
../../../src/bcast/.libs/libfile_bcast.a(libfile_bcast_la-file_bcast.o): In function `_get_job_info':
/usr/local/slurm-21.08.4/src/bcast/file_bcast.c:144: undefined reference to `slurm_get_selected_step_id'
collect2: error: ld returned 1 exit status
make[4]: *** [slurmd] Error 1
make[4]: Leaving directory `/usr/local/slurm-21.08.4/src/slurmd/slurmd'
make[3]: *** [all-recursive] Error 1
make[3]: Leaving directory `/usr/local/slurm-21.08.4/src/slurmd'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/usr/local/slurm-21.08.4/src'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/usr/local/slurm-21.08.4'
make: *** [all] Error 2
Comment 2 Jason Booth 2021-12-14 12:33:57 MST
Jeff this looks similar/same as bug#10679. I will have Marcin from our support team take a deeper look and let you know for sure.
Comment 3 Marcin Stolarek 2021-12-15 06:38:27 MST
Jeff,

It looks like the issue is that the linker makes use of libslurmfull from Slurm 20.11. 

If I read that part correctly:
>[...]-L/usr/lib -llz4 -L../../../src/api/.libs -lslurmfull 

It looks for the libslurmfull in /usr/lib, which I'm guessing is the location where you have previous version of Slurm installed?

cheers,
Marcin
Comment 4 Marcin Stolarek 2021-12-22 20:25:21 MST
Jeff,

Please let me know if you need more help on that. In case of no reply, I'll close the bug report as information given.

cheers,
Marcin
Comment 5 Marcin Stolarek 2021-12-27 03:38:49 MST
Jeff,

I'll go ahead and mark this case as resolved.

If you have any questions please reopen.

cheers,
Marcin