Sep 16 12:46:11 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 12:46:11 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 12:46:11 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 12:46:13 devstack cinder-volume[75748]: INFO dbcounter [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Registered counter for database cinder Sep 16 12:46:13 devstack cinder-volume[75748]: DEBUG oslo_db.sqlalchemy.engines [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:46:14 devstack cinder-volume[75748]: DEBUG dbcounter [-] [75748] Writer thread running {{(pid=75748) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 12:46:14 devstack cinder-volume[75748]: INFO cinder.rpc [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 12:46:14 devstack cinder-volume[75748]: INFO cinder.rpc [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 12:46:14 devstack cinder-volume[75748]: DEBUG oslo_db.sqlalchemy.engines [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:46:14 devstack cinder-volume[75748]: INFO cinder.volume.manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Determined volume DB was empty at startup. Sep 16 12:46:14 devstack cinder-volume[75748]: DEBUG cinder.volume.manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75748) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 12:46:14 devstack cinder-volume[75748]: INFO cinder.volume.manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 12:46:14 devstack cinder-volume[75748]: WARNING stevedore.named [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 12:46:14 devstack cinder-volume[75748]: WARNING castellan.key_manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 12:46:14 devstack cinder-volume[75748]: WARNING cinder.keymgr.conf_key_mgr [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 12:46:14 devstack cinder-volume[75748]: DEBUG cinder.volume.drivers.lvm [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75748) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 16 12:46:14 devstack cinder-volume[75748]: DEBUG oslo_concurrency.processutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_concurrency.processutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] CMD "cinder-rtstool verify" returned: 0 in 0.806s {{(pid=75748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_db.sqlalchemy.engines [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:46:15 devstack cinder-volume[75748]: INFO cinder.rpc [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 12:46:15 devstack cinder-volume[75748]: INFO cinder.rpc [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 12:46:15 devstack cinder-volume[75748]: WARNING stevedore.named [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 12:46:15 devstack cinder-volume[75748]: WARNING castellan.key_manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 12:46:15 devstack cinder-volume[75748]: INFO cinder.volume.manager [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_db.sqlalchemy.engines [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:46:15 devstack cinder-volume[75748]: INFO oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Starting 1 workers Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Started child 75880 {{(pid=75748) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Full set of CONF: {{(pid=75748) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] ******************************************************************************** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Configuration options gathered from: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] ================================================================================ {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] allow_availability_zone_fallback = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] allow_compression_on_image_upload = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] allowed_direct_url_schemes = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] api_rate_limit = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] auth_strategy = keystone {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] az_cache_duration = 3600 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_availability_zone = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_host = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_stats_polling_interval = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backup_api_class = cinder.backup.api.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backup_name_template = backup-%s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backup_use_same_host = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backup_use_temp_snapshot = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] chap_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] chap_username = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_internal_tenant_project_id = 25d3298dae474cd4b09dbc8568273b28 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_internal_tenant_user_id = ea23ecec70e2440eb64ff52aa253f263 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75880]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cloned_volume_same_az = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cluster = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] compression_format = gzip {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] compute_api_class = cinder.compute.nova.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] config_dir = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] config_source = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] control_exchange = openstack {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] debug = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] default_availability_zone = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] default_group_type = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] default_volume_type = lvmdriver-1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_client_cert = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_client_cert_key = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_data_namespace = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_ssl_cert_path = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_ssl_cert_verify = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] driver_use_ssl = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] enable_force_upload = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] enable_new_services = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] enable_unsupported_driver = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] enforce_multipath_for_image_xfer = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] filter_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_api_insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_api_ssl_compression = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_ca_certificates_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_catalog_info = image:glance:publicURL {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:15 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_num_retries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance_request_timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] goodness_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] graceful_shutdown_timeout = 5 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] group_api_class = cinder.group.api.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] host = devstack {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_compress_on_upload = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_conversion_address_space_limit = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_conversion_cpu_limit = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_conversion_disable = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_upload_use_cinder_backend = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_upload_use_internal_tenant = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_volume_cache_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_volume_cache_max_count = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] image_volume_cache_max_size_gb = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] init_host_max_objects_retrieval = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] instance_format = [instance: %(uuid)s] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iscsi_iotype = fileio {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iscsi_target_flags = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iscsi_write_cache = on {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iser_helper = tgtadm {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iser_ip_address = 192.168.122.224 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iser_port = 3260 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_color = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_config_append = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_dir = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_options = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_rotate_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_rotate_interval_type = days {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] log_rotation_type = none {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] max_age = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] max_logfile_count = 30 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] max_logfile_size_mb = 200 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] max_over_subscription_ratio = 20.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] message_reap_interval = 86400 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] message_ttl = 2592000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] migration_create_volume_timeout_secs = 300 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] monkey_patch = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] monkey_patch_modules = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] my_ip = 192.168.122.224 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] no_snapshot_gb_quota = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] num_iser_scan_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] num_shell_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] num_volume_device_scan_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] nvmeof_conn_info_version = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] nvmet_ns_id = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] nvmet_port_id = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_max_limit = 1000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_ext_list = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_listen_port = 8776 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_use_ssl = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] osapi_volume_workers = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] per_volume_size_limit = -1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] periodic_fuzzy_delay = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] periodic_interval = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] public_endpoint = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] publish_errors = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_backup_gigabytes = 1000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_backups = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_gigabytes = 1000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_groups = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_snapshots = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] quota_volumes = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] rate_limit_burst = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] rate_limit_except_level = CRITICAL {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] rate_limit_interval = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] reinit_driver_count = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] replication_device = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] report_discard_supported = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] report_interval = 120 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] reservation_clean_interval = 86400 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] reservation_expire = 86400 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] reserved_image_namespaces = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] reserved_percentage = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] rpc_response_timeout = 120 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] run_external_periodic_tasks = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] scst_target_driver = iscsi {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] scst_target_iqn_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_down_time = 720 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] shell_completion = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] snapshot_name_template = snapshot-%s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] snapshot_same_host = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] split_loggers = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] state_path = /opt/stack/data/cinder {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] storage_availability_zone = nova {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] storage_protocol = iSCSI {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] syslog_log_facility = LOG_USER {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_helper = lioadm {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_ip_address = 192.168.122.224 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_port = 3260 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_protocol = iscsi {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] target_secondary_ip_addresses = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] trace_flags = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] transport_url = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] until_refresh = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_chap_auth = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_default_quota_class = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_journal = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_json = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_multipath_for_image_xfer = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_stderr = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] use_syslog = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] verify_glance_signatures = enabled {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_api_class = cinder.volume.api.API {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_backend_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_clear = zero {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_clear_ionice = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_clear_size = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_copy_bps_limit = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_dd_blocksize = 1M {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_name_template = volume-%s {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_service_inithost_offload = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volume_usage_audit_period = month {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] watch_log_file = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] zoning_mode = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_concurrency.disable_process_locking = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.admin_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.admin_token = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.admin_user = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_port = 35357 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_protocol = https {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_section = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_type = password {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_uri = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.auth_version = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.cache = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.identity_uri = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.include_service_catalog = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.interface = public {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_password = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcache_username = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.region_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.service_type = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.backend = dogpile.cache.null {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.backend_argument = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.backend_expiration_time = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.config_prefix = cache.oslo {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.dead_timeout = 60.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.debug_cache_backend = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.enable_retry_client = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.enable_socket_keepalive = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.enforce_fips_mode = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.expiration_time = 600 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.hashclient_retry_attempts = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_dead_retry = 300 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_pool_maxsize = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_sasl_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.memcache_username = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.proxies = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_db = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_server = localhost:6379 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_socket_timeout = 1.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.redis_username = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.retry_attempts = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.retry_delay = 0.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.socket_keepalive_count = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.socket_keepalive_idle = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.socket_keepalive_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.tls_allowed_ciphers = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.tls_cafile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.tls_certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.tls_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cache.tls_keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] coordination.backend_url = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.asyncio_connection = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.asyncio_slave_connection = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.backend = sqlalchemy {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.connection = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.connection_debug = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.connection_parameters = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.connection_recycle_time = 3600 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.connection_trace = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.db_inc_retry_interval = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.db_max_retries = 20 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.db_max_retry_interval = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.db_retry_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.max_overflow = 50 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.max_pool_size = 5 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.max_retries = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.mysql_wsrep_sync_wait = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.pool_timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.retry_interval = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.slave_connection = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.sqlite_synchronous = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] database.use_db_reconnect = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.connection_string = messaging:// {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.es_doc_type = notification {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.es_scroll_size = 10000 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.es_scroll_time = 2m {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.filter_error_trace = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.hmac_keys = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.sentinel_service_name = mymaster {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.socket_timeout = 0.1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.trace_requests = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler.trace_sqlalchemy = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler_jaeger.process_tags = {} {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler_jaeger.service_name_prefix = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] profiler_otlp.service_name_prefix = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.enforce_new_defaults = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: WARNING oslo_config.cfg [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.enforce_scope = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.policy_default_rule = default {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.policy_file = policy.yaml {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.group = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.helper_command = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] privsep_osbrick.user = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.group = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.helper_command = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] cinder_sys_admin.user = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.auth_section = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.auth_type = password {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.collect_timing = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.send_service_user_token = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.split_loggers = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] service_user.timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.auth_section = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.auth_type = password {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.collect_timing = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.split_loggers = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] glance.timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.backend_availability_zone = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.154s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.chap_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.chap_username = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_client_cert = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_client_cert_key = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_data_namespace = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.driver_use_ssl = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.extra_capabilities = {} {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.filter_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.goodness_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iscsi_target_flags = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iscsi_write_cache = on {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iser_helper = tgtadm {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iser_port = 3260 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.lvm_share_target = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.lvm_type = auto {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.num_shell_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.replication_device = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.report_discard_supported = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.reserved_percentage = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_helper = tgtadm {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_port = 3260 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_protocol = iscsi {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.trace_flags = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.unique_fqdn_network = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.use_chap_auth = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_backend_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_clear = zero {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_clear_ionice = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_clear_size = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_reports.file_event_handler = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_reports.log_dir = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.backend_host = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.chap_password = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.chap_username = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_client_cert = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.extra_capabilities = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.filter_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.goodness_function = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iser_helper = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iser_ip_address = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iser_port = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.lvm_share_target = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.lvm_type = auto {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.num_shell_tries = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.replication_device = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.report_discard_supported = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.reserved_percentage = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.scst_target_driver = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.storage_protocol = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_helper = lioadm {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_ip_address = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_port = 3260 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.trace_flags = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.use_chap_auth = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_clear = zero {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_clear_size = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] lvmdriver-1.volumes_dir = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_notifications.driver = [] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_notifications.retry = -1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] key_manager.fixed_key = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.barbican_api_version = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.barbican_endpoint = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.barbican_endpoint_type = public {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.barbican_region_name = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.cafile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.collect_timing = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.number_of_retries = 60 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.retry_delay = 1 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.send_service_user_token = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.split_loggers = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.verify_ssl = True {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican.verify_ssl_path = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.auth_section = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.auth_type = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.cafile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.certfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.collect_timing = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.insecure = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.keyfile = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.split_loggers = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] barbican_service_user.timeout = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.approle_role_id = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.approle_secret_id = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.kv_mountpoint = secret {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.kv_path = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.kv_version = 2 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.namespace = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.root_token_id = **** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.ssl_ca_crt_file = None {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.timeout = 60.0 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.use_ssl = False {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:46:16 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] ******************************************************************************** {{(pid=75748) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.161s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.087s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:16 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:16 devstack sudo[75926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 12:46:16 devstack sudo[75926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:18 devstack sudo[75926]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:18 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.995s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:18 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:18 devstack sudo[76045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:18 devstack sudo[76045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:20 devstack sudo[76045]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:20 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.995s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:20 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 12:46:20 devstack cinder-volume[75880]: INFO cinder.brick.local_dev.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 12:46:20 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:20 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.076s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:20 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:20 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:46:20 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:22 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:22 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.962s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:22 devstack cinder-volume[75880]: DEBUG cinder.brick.local_dev.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75880) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 16 12:46:22 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:22 devstack sudo[76236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:22 devstack sudo[76236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:25 devstack cinder-volume[75748]: DEBUG dbcounter [-] [75748] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75748) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:46:26 devstack sudo[76236]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.327s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.105s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:26 devstack sudo[76420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:26 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:28 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:28 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.107s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:28 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:28 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.153s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:28 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:28 devstack sudo[76477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 12:46:28 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:30 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:30 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.040s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:30 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:30 devstack sudo[76494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:46:30 devstack sudo[76494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:33 devstack sudo[76494]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:33 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.939s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:33 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:33 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:46:33 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:36 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:36 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.875s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:36 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:36 devstack sudo[76585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:46:36 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:39 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:39 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.966s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:39 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:39 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:39 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:41 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:41 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.172s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:41 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:41 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:41 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:42 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:42 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:44 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:44 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.318s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:44 devstack cinder-volume[75880]: INFO cinder.volume.drivers.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 12:46:44 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:44 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.090s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:44 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:44 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:44 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:46 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:46 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.939s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:46 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:46:46 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:46 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:46:46 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:48 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:48 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.938s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:48 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:48 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:46:48 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:50 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:50 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.123s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:50 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:50 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:46:50 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:52 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:52 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.065s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:52 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:52 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:46:52 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:54 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:54 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.058s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:54 devstack cinder-volume[75880]: INFO cinder.volume.driver [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 12:46:54 devstack cinder-volume[75880]: DEBUG cinder.volume.driver [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75880) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 12:46:54 devstack cinder-volume[75880]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:46:54 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writer thread running {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 12:46:55 devstack cinder-volume[75880]: DEBUG cinder.db.sqlalchemy.api [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Building query based on filter {{(pid=75880) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 12:46:55 devstack cinder-volume[75880]: DEBUG cinder.image.image_utils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75880) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 12:46:55 devstack cinder-volume[75880]: INFO cinder.keymgr.migration [None req-108076cd-77fa-4868-9104-97a1c993d710 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 12:46:55 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:46:55 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:55 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:46:55 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:46:57 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Sep 16 12:46:57 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.298s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:46:57 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:46:57 devstack sudo[76910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:46:57 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:00 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.753s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:00 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:47:00 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:03 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.065s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:03 devstack sudo[77061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:47:03 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=2 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:47:05 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.212s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:47:05 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Driver initialization completed successfully. Sep 16 12:47:05 devstack cinder-volume[75880]: INFO cinder.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Initiating service 2 cleanup Sep 16 12:47:05 devstack cinder-volume[75880]: INFO cinder.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Service 2 cleanup completed. Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG cinder.service [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Creating RPC server for service cinder-volume {{(pid=75880) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG cinder.service [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75880) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 12:47:05 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:47:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:05 devstack sudo[77066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:47:05 devstack sudo[77066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:07 devstack sudo[77066]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.926s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:07 devstack sudo[77074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:47:07 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:09 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:09 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:09 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:09 devstack sudo[77077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:47:09 devstack sudo[77077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:11 devstack sudo[77077]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:11 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.870s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:11 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:11 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:47:11 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:13 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.909s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:13 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-f9b72d2d-1646-481c-ae19-a08772638df2 None None] Driver post RPC initialization completed successfully. Sep 16 12:47:13 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:47:13 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:47:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:13 devstack sudo[77088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:47:13 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:15 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.873s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:15 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:47:15 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:17 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.188s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:17 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:47:18 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:19 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.709s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:47:19 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:47:19 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:47:21 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Sep 16 12:47:21 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.662s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:47:21 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:47:23 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=2 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:47:23 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:49:13 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:49:13 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:49:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:49:13 devstack sudo[78993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:49:13 devstack sudo[78993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:49:15 devstack sudo[78993]: pam_unix(sudo:session): session closed for user root Sep 16 12:49:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.940s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:49:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:49:15 devstack sudo[79088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:49:15 devstack sudo[79088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:49:17 devstack sudo[79088]: pam_unix(sudo:session): session closed for user root Sep 16 12:49:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.984s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:49:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:49:17 devstack sudo[79178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:49:17 devstack sudo[79178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:49:19 devstack sudo[79178]: pam_unix(sudo:session): session closed for user root Sep 16 12:49:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.874s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:49:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:49:19 devstack sudo[79188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:49:19 devstack sudo[79188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:49:21 devstack sudo[79188]: pam_unix(sudo:session): session closed for user root Sep 16 12:49:21 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.002s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:49:21 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:49:23 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:49:24 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:50:13 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:50:13 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:50:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:50:13 devstack sudo[81964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:50:13 devstack sudo[81964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:50:15 devstack sudo[81964]: pam_unix(sudo:session): session closed for user root Sep 16 12:50:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.875s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:50:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:50:15 devstack sudo[81970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:50:15 devstack sudo[81970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:50:17 devstack sudo[81970]: pam_unix(sudo:session): session closed for user root Sep 16 12:50:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.858s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:50:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:50:17 devstack sudo[81973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:50:17 devstack sudo[81973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:50:19 devstack sudo[81973]: pam_unix(sudo:session): session closed for user root Sep 16 12:50:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.830s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:50:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:50:19 devstack sudo[81976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:50:19 devstack sudo[81976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:50:21 devstack sudo[81976]: pam_unix(sudo:session): session closed for user root Sep 16 12:50:21 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.920s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:50:21 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:51:13 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:51:13 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:51:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:51:13 devstack sudo[82189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:51:14 devstack sudo[82189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:51:15 devstack sudo[82189]: pam_unix(sudo:session): session closed for user root Sep 16 12:51:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.984s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:51:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:51:15 devstack sudo[82226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:51:15 devstack sudo[82226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:51:17 devstack sudo[82226]: pam_unix(sudo:session): session closed for user root Sep 16 12:51:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.941s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:51:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:51:17 devstack sudo[82273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:51:17 devstack sudo[82273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:51:19 devstack sudo[82273]: pam_unix(sudo:session): session closed for user root Sep 16 12:51:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.903s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:51:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:51:19 devstack sudo[82277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:51:19 devstack sudo[82277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:51:21 devstack sudo[82277]: pam_unix(sudo:session): session closed for user root Sep 16 12:51:21 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.942s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:51:21 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:51:23 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:51:24 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:52:13 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:52:13 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 12:52:13 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:52:13 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 12:52:14 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:52:15 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Sep 16 12:52:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.960s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:52:15 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:52:15 devstack sudo[82398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:52:15 devstack sudo[82398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:52:17 devstack sudo[82398]: pam_unix(sudo:session): session closed for user root Sep 16 12:52:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.886s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:52:17 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:52:17 devstack sudo[82452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 12:52:17 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:52:19 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root Sep 16 12:52:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.997s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:52:19 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:52:19 devstack sudo[82580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 12:52:19 devstack sudo[82580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:52:21 devstack sudo[82580]: pam_unix(sudo:session): session closed for user root Sep 16 12:52:21 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.026s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:52:21 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-967f8a17-1fe2-4f6f-b0ce-82bef0450294 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:52:44 devstack cinder-volume[75748]: INFO oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Caught SIGTERM, stopping children Sep 16 12:52:44 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Acquiring lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 12:52:44 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Acquired lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 12:52:44 devstack cinder-volume[75748]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Releasing lock "singleton_lock" {{(pid=75748) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 12:52:44 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Stop services. {{(pid=75748) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 16 12:52:44 devstack cinder-volume[75748]: DEBUG oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Killing children. {{(pid=75748) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 16 12:52:44 devstack cinder-volume[75748]: INFO oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Waiting on 1 children to exit Sep 16 12:52:45 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Acquiring lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 12:52:45 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Acquired lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 12:52:45 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Releasing lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 12:52:45 devstack cinder-volume[75880]: WARNING amqp [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 12:52:45 devstack cinder-volume[75880]: WARNING amqp [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 12:52:46 devstack cinder-volume[75748]: INFO oslo_service.backend._eventlet.service [None req-b2986efe-7149-4b8a-bb59-b8fee41d3218 None None] Child 75880 exited with status 0 Sep 16 12:53:03 devstack cinder-volume[83272]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83272) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 12:53:03 devstack cinder-volume[83272]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83272) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 12:53:03 devstack cinder-volume[83272]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83272) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 12:53:07 devstack cinder-volume[83272]: INFO dbcounter [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Registered counter for database cinder Sep 16 12:53:08 devstack cinder-volume[83272]: DEBUG oslo_db.sqlalchemy.engines [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:53:09 devstack cinder-volume[83272]: DEBUG dbcounter [-] [83272] Writer thread running {{(pid=83272) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 12:53:09 devstack cinder-volume[83272]: INFO cinder.rpc [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 12:53:09 devstack cinder-volume[83272]: INFO cinder.rpc [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 12:53:09 devstack cinder-volume[83272]: DEBUG oslo_db.sqlalchemy.engines [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:53:09 devstack cinder-volume[83272]: INFO cinder.volume.manager [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Determined volume DB was empty at startup. Sep 16 12:53:09 devstack cinder-volume[83272]: DEBUG cinder.volume.manager [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83272) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 12:53:09 devstack cinder-volume[83272]: INFO cinder.volume.manager [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 12:53:09 devstack cinder-volume[83272]: WARNING stevedore.named [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 12:53:09 devstack cinder-volume[83272]: WARNING castellan.key_manager [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 12:53:09 devstack cinder-volume[83272]: WARNING cinder.keymgr.conf_key_mgr [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 12:53:10 devstack cinder-volume[83272]: INFO cinder.volume.manager [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_db.sqlalchemy.engines [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83272) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:53:10 devstack cinder-volume[83272]: INFO oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Starting 1 workers Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Started child 83513 {{(pid=83272) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Full set of CONF: {{(pid=83272) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] ******************************************************************************** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Configuration options gathered from: {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] ================================================================================ {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] allow_availability_zone_fallback = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] allow_compression_on_image_upload = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] allowed_direct_url_schemes = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] api_rate_limit = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] auth_strategy = keystone {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_availability_zone = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_host = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_stats_polling_interval = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backup_api_class = cinder.backup.api.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backup_name_template = backup-%s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backup_use_same_host = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backup_use_temp_snapshot = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] chap_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] chap_username = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_internal_tenant_project_id = 25d3298dae474cd4b09dbc8568273b28 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_internal_tenant_user_id = ea23ecec70e2440eb64ff52aa253f263 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cluster = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] compression_format = gzip {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] compute_api_class = cinder.compute.nova.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] config_dir = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] config_source = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] control_exchange = openstack {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] debug = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] default_availability_zone = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] default_group_type = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] default_volume_type = QuobyteHD {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_client_cert = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_client_cert_key = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_data_namespace = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_ssl_cert_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_ssl_cert_verify = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] driver_use_ssl = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] enable_new_services = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] enable_unsupported_driver = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] enabled_backends = ['QuobyteHD'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] enforce_multipath_for_image_xfer = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] filter_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_api_insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_api_ssl_compression = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_ca_certificates_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_catalog_info = image:glance:publicURL {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_num_retries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance_request_timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] goodness_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] graceful_shutdown_timeout = 5 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] group_api_class = cinder.group.api.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] host = devstack {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_compress_on_upload = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_conversion_address_space_limit = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_conversion_cpu_limit = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_conversion_disable = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_upload_use_cinder_backend = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_upload_use_internal_tenant = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_volume_cache_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_volume_cache_max_count = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] image_volume_cache_max_size_gb = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] init_host_max_objects_retrieval = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] instance_format = [instance: %(uuid)s] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iscsi_iotype = fileio {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iscsi_target_flags = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iscsi_write_cache = on {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iser_helper = tgtadm {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iser_ip_address = 192.168.122.224 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iser_port = 3260 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_color = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_config_append = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_dir = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_options = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_rotate_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_rotate_interval_type = days {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] log_rotation_type = none {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] max_age = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] max_logfile_count = 30 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] max_logfile_size_mb = 200 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] max_over_subscription_ratio = 20.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] message_reap_interval = 86400 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] message_ttl = 2592000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] migration_create_volume_timeout_secs = 300 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] monkey_patch = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] monkey_patch_modules = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] my_ip = 192.168.122.224 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] no_snapshot_gb_quota = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] num_iser_scan_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] num_shell_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] num_volume_device_scan_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] nvmeof_conn_info_version = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] nvmet_ns_id = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] nvmet_port_id = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_max_limit = 1000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_ext_list = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_listen_port = 8776 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_use_ssl = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] osapi_volume_workers = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] per_volume_size_limit = -1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] periodic_fuzzy_delay = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] periodic_interval = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] public_endpoint = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] publish_errors = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83513]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_backup_gigabytes = 1000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_backups = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_gigabytes = 1000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_groups = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_snapshots = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] quota_volumes = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] rate_limit_burst = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] rate_limit_except_level = CRITICAL {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] rate_limit_interval = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] reinit_driver_count = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] replication_device = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] report_discard_supported = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] report_interval = 120 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] reservation_clean_interval = 86400 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] reservation_expire = 86400 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] reserved_image_namespaces = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] reserved_percentage = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] rpc_response_timeout = 120 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] run_external_periodic_tasks = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] scst_target_driver = iscsi {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] scst_target_iqn_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_down_time = 720 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] shell_completion = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] snapshot_name_template = snapshot-%s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] split_loggers = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] state_path = /opt/stack/data/cinder {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] storage_availability_zone = nova {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] storage_protocol = iSCSI {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] syslog_log_facility = LOG_USER {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_helper = lioadm {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_ip_address = 192.168.122.224 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_port = 3260 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_protocol = iscsi {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] target_secondary_ip_addresses = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] trace_flags = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] transport_url = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] until_refresh = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_chap_auth = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_default_quota_class = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_journal = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_json = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_multipath_for_image_xfer = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_stderr = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] use_syslog = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] verify_glance_signatures = enabled {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_api_class = cinder.volume.api.API {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_backend_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_clear = zero {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_clear_ionice = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_clear_size = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_copy_bps_limit = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_dd_blocksize = 1M {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_name_template = volume-%s {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_service_inithost_offload = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volume_usage_audit_period = month {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] watch_log_file = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] zoning_mode = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_concurrency.disable_process_locking = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.admin_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.admin_token = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.admin_user = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_port = 35357 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_protocol = https {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_section = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_type = password {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_uri = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.auth_version = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.cache = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.identity_uri = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.include_service_catalog = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.interface = public {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_password = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcache_username = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.region_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.service_type = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.backend = dogpile.cache.null {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.backend_argument = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.backend_expiration_time = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.config_prefix = cache.oslo {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.dead_timeout = 60.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.debug_cache_backend = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.enable_retry_client = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.enable_socket_keepalive = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.enforce_fips_mode = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.expiration_time = 600 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.hashclient_retry_attempts = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.hashclient_retry_delay = 1.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_dead_retry = 300 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_pool_maxsize = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_sasl_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_socket_timeout = 1.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.memcache_username = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.proxies = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_db = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_server = localhost:6379 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_socket_timeout = 1.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.redis_username = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.retry_attempts = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.retry_delay = 0.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.socket_keepalive_count = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.socket_keepalive_idle = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.socket_keepalive_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.tls_allowed_ciphers = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.tls_cafile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.tls_certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.tls_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cache.tls_keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] coordination.backend_url = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.asyncio_connection = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.asyncio_slave_connection = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.backend = sqlalchemy {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.connection = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.connection_debug = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.connection_parameters = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.connection_recycle_time = 3600 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.connection_trace = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.db_inc_retry_interval = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.db_max_retries = 20 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.db_max_retry_interval = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.db_retry_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.max_overflow = 50 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.max_pool_size = 5 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.max_retries = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.mysql_wsrep_sync_wait = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.pool_timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.retry_interval = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.slave_connection = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.sqlite_synchronous = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] database.use_db_reconnect = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.connection_string = messaging:// {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.es_doc_type = notification {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.es_scroll_size = 10000 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.es_scroll_time = 2m {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.filter_error_trace = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.hmac_keys = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.sentinel_service_name = mymaster {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.socket_timeout = 0.1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.trace_requests = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler.trace_sqlalchemy = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler_jaeger.process_tags = {} {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler_jaeger.service_name_prefix = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] profiler_otlp.service_name_prefix = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.enforce_new_defaults = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: WARNING oslo_config.cfg [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.enforce_scope = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.policy_default_rule = default {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.policy_file = policy.yaml {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.group = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.helper_command = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] privsep_osbrick.user = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.group = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.helper_command = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] cinder_sys_admin.user = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.auth_section = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.auth_type = password {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.collect_timing = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.send_service_user_token = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.split_loggers = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] service_user.timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.auth_section = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.auth_type = password {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.collect_timing = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.split_loggers = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] glance.timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.backend_availability_zone = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.chap_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.chap_username = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_client_cert = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_client_cert_key = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_data_namespace = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.driver_use_ssl = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.extra_capabilities = {} {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.filter_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.goodness_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iscsi_iotype = fileio {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iscsi_target_flags = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iscsi_write_cache = on {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iser_helper = tgtadm {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iser_port = 3260 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_host = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_login = admin {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_mount_options = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_private_key = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_share_path = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.num_shell_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.quobyte_volume_url = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.replication_device = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.report_discard_supported = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.reserved_percentage = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_helper = tgtadm {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_port = 3260 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_protocol = iscsi {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.trace_flags = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.unique_fqdn_network = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.use_chap_auth = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_backend_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_clear = zero {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_clear_ionice = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_clear_size = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_reports.file_event_handler = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_reports.log_dir = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.backend_availability_zone = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.backend_host = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.chap_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.chap_username = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.chiscsi_conf = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_client_cert = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_data_namespace = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.driver_use_ssl = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.extra_capabilities = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.filter_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.goodness_function = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iscsi_iotype = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iser_helper = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iser_ip_address = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iser_port = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.iser_target_prefix = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_host = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_login = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_mount_options = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_password = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_private_key = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_share_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_ssh_port = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.num_shell_tries = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.nvmet_port_id = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.replication_device = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.report_discard_supported = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.reserved_percentage = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.scst_target_driver = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.storage_protocol = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_helper = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_ip_address = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_port = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_prefix = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_protocol = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.trace_flags = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.use_chap_auth = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_clear = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_clear_size = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] QuobyteHD.volumes_dir = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_notifications.driver = [] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_notifications.retry = -1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] key_manager.fixed_key = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.barbican_api_version = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.barbican_endpoint = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.barbican_endpoint_type = public {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.barbican_region_name = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.cafile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.collect_timing = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.number_of_retries = 60 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.retry_delay = 1 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.send_service_user_token = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.split_loggers = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.verify_ssl = True {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican.verify_ssl_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.auth_section = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.auth_type = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.cafile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.certfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.collect_timing = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.insecure = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.keyfile = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.split_loggers = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] barbican_service_user.timeout = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.approle_role_id = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.approle_secret_id = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.kv_mountpoint = secret {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.kv_path = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.kv_version = 2 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.namespace = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.root_token_id = **** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.ssl_ca_crt_file = None {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.timeout = 60.0 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.use_ssl = False {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 12:53:10 devstack cinder-volume[83272]: DEBUG oslo_service.backend._eventlet.service [None req-69fc8bef-adf3-42bc-9c37-c1f729e03b70 None None] ******************************************************************************** {{(pid=83272) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 12:53:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:53:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Starting volume driver QuobyteDriver (1.1.14) Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83513) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83513) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:308}} Sep 16 12:53:11 devstack cinder-volume[83513]: INFO cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Running cmd (subprocess): mount.quobyte {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:53:11 devstack quobyte-client[83526]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 12:53:11 devstack quobyte-client[83526]: Invalid parameters found, error: missing mount point. Sep 16 12:53:11 devstack quobyte-client[83526]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 12:53:11 devstack quobyte-client[83526]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] CMD "mount.quobyte" returned: 1 in 0.560s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:53:11 devstack cinder-volume[83513]: INFO cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Mounting volume: 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 ... Sep 16 12:53:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 -c /etc/quobyte/client-cinder.cfg {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:53:12 devstack quobyte-client[83535]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 16 12:53:12 devstack quobyte-client[83535]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 12:53:12 devstack quobyte-client[83535]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558' to display the log. Sep 16 12:53:12 devstack quobyte-client[83541]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 16 12:53:12 devstack quobyte-client[83541]: mount.quobyte 3.25 (4fbbd59204) Sep 16 12:53:12 devstack quobyte-client[83541]: Client UUID: TKuar6ye-gCdq-6hpq-Hek4-ShZckrYUDMv3 Sep 16 12:53:12 devstack quobyte-client[83541]: Registry: osci01.corp.quobyte.com:7861 Sep 16 12:53:12 devstack quobyte-client[83541]: Volume: cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:53:12 devstack quobyte-client[83541]: FUSE version: 316 Sep 16 12:53:12 devstack quobyte-client[83541]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 16 12:53:12 devstack quobyte-client[83541]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 16 12:53:12 devstack quobyte-client[83541]: Setting total object cache size to 3352297472 bytes Sep 16 12:53:12 devstack quobyte-client[83541]: Using FUSE low-level API Sep 16 12:53:12 devstack quobyte-client[83541]: Caching of uid/gid to user/group name mappings is enabled Sep 16 12:53:12 devstack quobyte-client[83541]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 16 12:53:12 devstack quobyte-client[83541]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 16 12:53:12 devstack quobyte-client[83541]: HTTP server started on port 55000 Sep 16 12:53:12 devstack quobyte-client[83541]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 16 12:53:12 devstack quobyte-client[83541]: Mount point /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 established Sep 16 12:53:12 devstack quobyte-client[83541]: TimeSync is running and remote sync every 60 seconds Sep 16 12:53:12 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:12 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:12 devstack quobyte-client[83541]: Opening volume cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 (6e8c7697-8e04-496a-b7b4-368487b85e35) Sep 16 12:53:12 devstack quobyte-client[83541]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 16 12:53:12 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:12 devstack quobyte-client[83541]: Failed to invalidate inode: 38: Function not implemented Sep 16 12:53:12 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:12 devstack quobyte-client[83541]: Automatic minidump upload enabled by global system configuration Sep 16 12:53:12 devstack quobyte-client[83541]: Announcing HTTP status server address 172.24.4.1 Sep 16 12:53:12 devstack quobyte-client[83541]: Registered as service (uuid TKuar6ye-gCdq-6hpq-Hek4-ShZckrYUDMv3) Sep 16 12:53:12 devstack quobyte-client[83541]: Quobyte Client running as pid 83541 Sep 16 12:53:12 devstack quobyte-client[83541]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 16 12:53:12 devstack quobyte-client[83541]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.755s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:53:12 devstack cinder-volume[83513]: INFO cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Mounting volume: 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 succeeded Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.818s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:53:12 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.073s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:53:12 devstack cinder-volume[83513]: INFO cinder.volume.driver [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG cinder.volume.driver [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83513) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 12:53:12 devstack cinder-volume[83513]: DEBUG oslo_db.sqlalchemy.engines [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writer thread running {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.db.sqlalchemy.api [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Building query based on filter {{(pid=83513) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83513) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 12:53:13 devstack cinder-volume[83513]: INFO cinder.keymgr.migration [None req-f65f70e8-6740-4778-85f5-8a1d214293f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:53:13 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Driver initialization completed successfully. Sep 16 12:53:13 devstack cinder-volume[83513]: INFO cinder.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Initiating service 3 cleanup Sep 16 12:53:13 devstack cinder-volume[83513]: INFO cinder.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Service 3 cleanup completed. Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.service [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Creating RPC server for service cinder-volume {{(pid=83513) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.service [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83513) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 12:53:13 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Sep 16 12:53:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:53:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:53:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:53:14 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-477c05f7-3444-442f-b09d-9e7621c5fcb0 None None] Driver post RPC initialization completed successfully. Sep 16 12:53:15 devstack quobyte-client[83541]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 12:53:20 devstack cinder-volume[83272]: DEBUG dbcounter [-] [83272] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83272) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:53:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:53:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:54:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Flow 'volume_create_manager' (0f8ea4e0-e1f4-4c7a-b024-a206cfa51a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03f4c29-9568-4759-a999-3478bb1c2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03f4c29-9568-4759-a999-3478bb1c2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-507281854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b700740-2784-4f91-9b34-50124f70a75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a62ea3bac5e4f1fbe87083b9c58cb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:54:25Z,use_quota=True,user_id='5d7652e8022e4b56874945862fbccaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80efe898-08c0-4e00-9720-51d8abbf57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80efe898-08c0-4e00-9720-51d8abbf57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c24741d-d058-4824-affb-cbeaeb5dcef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c24741d-d058-4824-affb-cbeaeb5dcef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b700740-2784-4f91-9b34-50124f70a75b', 'volume_name': 'volume-9b700740-2784-4f91-9b34-50124f70a75b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95951a15-ce5b-4dc8-85c5-341fb31e7cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95951a15-ce5b-4dc8-85c5-341fb31e7cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee842d32-5f7c-4160-837b-a55b1663aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:25 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume 9b700740-2784-4f91-9b34-50124f70a75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b700740-2784-4f91-9b34-50124f70a75b', 'volume_size': 1} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-507281854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b700740-2784-4f91-9b34-50124f70a75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a62ea3bac5e4f1fbe87083b9c58cb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:54:25Z,use_quota=True,user_id='5d7652e8022e4b56874945862fbccaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Creating volume 9b700740-2784-4f91-9b34-50124f70a75b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:54:25 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:54:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:54:25 devstack quobyte-client[83541]: System call of process 83803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:54:26 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=2, name=volume-9b700740-2784-4f91-9b34-50124f70a75b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b 1073741824" returned: 0 in 1.435s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] <== create_volume: return (1624ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee842d32-5f7c-4160-837b-a55b1663aedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b700740-2784-4f91-9b34-50124f70a75b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4176ae-82d1-41fb-ac59-ad6363e2d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:54:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume volume-9b700740-2784-4f91-9b34-50124f70a75b (9b700740-2784-4f91-9b34-50124f70a75b): created successfully Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4176ae-82d1-41fb-ac59-ad6363e2d04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:54:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Flow 'volume_create_manager' (0f8ea4e0-e1f4-4c7a-b024-a206cfa51a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:54:27 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bf78a263-b249-48fa-bb35-5e60960ac7de tempest-VolumesAssistedSnapshotsTest-721534254 None] Created volume successfully. Sep 16 12:54:37 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:54:38 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.174s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:54:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:55:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:55:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:55:33 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:55:33 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Flow 'volume_create_manager' (9adc085d-da00-485a-bae3-078ae1deef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bee7a5-a449-4e3c-a679-bc5036338df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bee7a5-a449-4e3c-a679-bc5036338df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1485825330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4606cac6-b5db-495f-8277-d9ddb2ba2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd20b0990814394a5665e6e5bb156be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:55:34Z,use_quota=True,user_id='9ffe2ae39fdc4e9e9dd11cdf9dd6b2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3480f1d5-041f-4fc5-bda5-79e90ad6ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3480f1d5-041f-4fc5-bda5-79e90ad6ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a4a14-a595-4089-bb2a-b464cea7635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9a4a14-a595-4089-bb2a-b464cea7635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4606cac6-b5db-495f-8277-d9ddb2ba2193', 'volume_name': 'volume-4606cac6-b5db-495f-8277-d9ddb2ba2193', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40132d6-3955-4dec-b583-5f6fe0a10f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40132d6-3955-4dec-b583-5f6fe0a10f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ce2b1-9716-4105-964f-b6dad6146b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Volume 4606cac6-b5db-495f-8277-d9ddb2ba2193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4606cac6-b5db-495f-8277-d9ddb2ba2193', 'volume_size': 1} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1485825330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4606cac6-b5db-495f-8277-d9ddb2ba2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd20b0990814394a5665e6e5bb156be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:55:34Z,use_quota=True,user_id='9ffe2ae39fdc4e9e9dd11cdf9dd6b2b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Creating volume 4606cac6-b5db-495f-8277-d9ddb2ba2193 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.179s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:55:34 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:55:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=3, name=volume-4606cac6-b5db-495f-8277-d9ddb2ba2193, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:55:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 1073741824" returned: 0 in 1.078s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193" returned: 0 in 0.154s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] <== create_volume: return (1548ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ce2b1-9716-4105-964f-b6dad6146b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4606cac6-b5db-495f-8277-d9ddb2ba2193', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca60d0e-477f-4a9c-82b2-4e4afe30a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:55:36 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Volume volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 (4606cac6-b5db-495f-8277-d9ddb2ba2193): created successfully Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca60d0e-477f-4a9c-82b2-4e4afe30a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:55:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Flow 'volume_create_manager' (9adc085d-da00-485a-bae3-078ae1deef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:55:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a0b60905-048c-4b07-96ac-0fa677031cfe tempest-VolumesAdminNegativeTest-1388553544 None] Created volume successfully. Sep 16 12:55:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Acquiring lock "cinder-4606cac6-b5db-495f-8277-d9ddb2ba2193-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:55:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "cinder-4606cac6-b5db-495f-8277-d9ddb2ba2193-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:55:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:55:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Acquiring lock "cinder-quobyte-4606cac6-b5db-495f-8277-d9ddb2ba2193" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:55:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "cinder-quobyte-4606cac6-b5db-495f-8277-d9ddb2ba2193" acquired by "delete_volume" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:55:38 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp30iwmdk9/privsep.sock'] Sep 16 12:55:38 devstack sudo[84766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp30iwmdk9/privsep.sock Sep 16 12:55:38 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.229s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:55:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:55:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:55:50 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root Sep 16 12:55:50 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Spawned new privsep daemon via rootwrap Sep 16 12:55:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Accepted privsep connection to /tmp/tmp30iwmdk9/privsep.sock {{(pid=83513) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 16 12:55:50 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 12:55:50 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 12:55:50 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 12:55:50 devstack cinder-volume[83513]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84812 Sep 16 12:55:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cd9d5-e0bc-4b2b-a144-b066e824c8ac]: (2,) {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:55:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f61797-c2f0-4964-8900-aaa87dcc60a5]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:55:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:51 devstack quobyte-client[83541]: System call of process 84842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:55:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193" returned: 0 in 1.196s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4606cac6-b5db-495f-8277-d9ddb2ba2193" returned: 0 in 0.219s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "cinder-quobyte-4606cac6-b5db-495f-8277-d9ddb2ba2193" released by "delete_volume" :: held 13.791s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:55:53 devstack cinder-volume[83513]: WARNING cinder.quota [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:55:53 devstack cinder-volume[83513]: WARNING cinder.quota [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:55:53 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Created reservations ['54dc1ee7-0987-41a9-8047-3bda6a5a14e6', 'ed19edcb-1632-4c47-aa58-4d15b987f26c', '5002a4f0-db13-4f10-9997-3d38d8a170ad', 'c231b0e8-fe5a-4a24-9d54-5b8472694bfd'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.307s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:55:54 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:55:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Deleted volume successfully. Sep 16 12:55:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8369459b-92a8-4f2c-b411-62f6ff1f1743 tempest-VolumesAdminNegativeTest-1388553544 None] Lock "cinder-4606cac6-b5db-495f-8277-d9ddb2ba2193-delete_volume" released by "delete_volume" :: held 16.683s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:04 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:56:04 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:56:35 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Flow 'volume_create_manager' (b671403a-ef87-4323-b185-63e7ee72bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479f2901-5fd1-43a5-b898-10822d2bc96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479f2901-5fd1-43a5-b898-10822d2bc96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2138822265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858d566-4bb7-4c60-a73b-9c6ec9a86519,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6f334c9cbb1408d8150bb0508637847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:35Z,use_quota=True,user_id='c88f44edebcd4a7c94fa7148969623da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8152e846-ddbf-4da8-9f19-854b326ca564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8152e846-ddbf-4da8-9f19-854b326ca564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc5003-828a-4f22-a6ec-49ebbc2cb2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc5003-828a-4f22-a6ec-49ebbc2cb2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3858d566-4bb7-4c60-a73b-9c6ec9a86519', 'volume_name': 'volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9796a95-761b-40a2-a712-cc0ff08188f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9796a95-761b-40a2-a712-cc0ff08188f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc7b4e-997b-48ef-8db8-84ba011e12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:35 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Volume 3858d566-4bb7-4c60-a73b-9c6ec9a86519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519', 'volume_size': 1} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2138822265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858d566-4bb7-4c60-a73b-9c6ec9a86519,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6f334c9cbb1408d8150bb0508637847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:35Z,use_quota=True,user_id='c88f44edebcd4a7c94fa7148969623da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Creating volume 3858d566-4bb7-4c60-a73b-9c6ec9a86519 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:56:35 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:35 devstack quobyte-client[83541]: System call of process 85062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:56:35 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=4, name=volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 1073741824" returned: 0 in 0.333s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.501s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc7b4e-997b-48ef-8db8-84ba011e12b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f3d5a9-da7e-40c2-b185-aa93b81224e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:36 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Volume volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 (3858d566-4bb7-4c60-a73b-9c6ec9a86519): created successfully Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f3d5a9-da7e-40c2-b185-aa93b81224e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Flow 'volume_create_manager' (b671403a-ef87-4323-b185-63e7ee72bc87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-12450b4e-46c3-44dd-80de-fa555659e986 req-21485cb0-1892-4c01-9090-9ab67d8e1f40 tempest-VolumesGetTestJSON-1065003849 None] Created volume successfully. Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Acquiring lock "cinder-3858d566-4bb7-4c60-a73b-9c6ec9a86519-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "cinder-3858d566-4bb7-4c60-a73b-9c6ec9a86519-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Acquiring lock "cinder-quobyte-3858d566-4bb7-4c60-a73b-9c6ec9a86519" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "cinder-quobyte-3858d566-4bb7-4c60-a73b-9c6ec9a86519" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3980a2-3ccf-4498-8d76-977eeb530756]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519" returned: 0 in 0.455s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3858d566-4bb7-4c60-a73b-9c6ec9a86519" returned: 0 in 0.095s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "cinder-quobyte-3858d566-4bb7-4c60-a73b-9c6ec9a86519" released by "delete_volume" :: held 0.704s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:37 devstack cinder-volume[83513]: DEBUG cinder.quota [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Created reservations ['5251c1e5-0e02-4208-9edf-91655647ec46', '74dce302-0a88-4eb9-baf4-f74837dedecd', '12ab5959-3a4c-4d38-992d-2d45f51e0644', 'b605cd2d-256f-4bcc-91c4-1e62a407f9ba'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG cinder.manager [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:56:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Deleted volume successfully. Sep 16 12:56:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-ac1ad04d-89de-46c2-b781-4c78eb13e0be req-a372d359-874b-472a-9bfd-c55dc3dd1128 tempest-VolumesGetTestJSON-1065003849 None] Lock "cinder-3858d566-4bb7-4c60-a73b-9c6ec9a86519-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:56:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (3f7ca4f9-b5c0-45a8-b2c7-0ccbbaf83b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0758563c-d648-4d14-b119-0b7d956d5977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0758563c-d648-4d14-b119-0b7d956d5977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723267225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19e83f7-4eab-45b0-b999-15db2d7f5c42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:43Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97995db-9d49-4660-8d5a-278a9c6c77ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97995db-9d49-4660-8d5a-278a9c6c77ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3e4a7f-4a19-49a2-81c7-1ff634b6d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3e4a7f-4a19-49a2-81c7-1ff634b6d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19e83f7-4eab-45b0-b999-15db2d7f5c42', 'volume_name': 'volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae90349a-9395-4cb4-847b-f97b00d57256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae90349a-9395-4cb4-847b-f97b00d57256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc1fa34-e840-416a-b277-37dcb8af84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Volume d19e83f7-4eab-45b0-b999-15db2d7f5c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42', 'volume_size': 1} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723267225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19e83f7-4eab-45b0-b999-15db2d7f5c42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:43Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Creating volume d19e83f7-4eab-45b0-b999-15db2d7f5c42 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:56:43 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:56:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:43 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=5, name=volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:56:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Flow 'volume_create_manager' (e7accdc7-115c-4393-9a3b-8339bf9b3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801f6727-1101-433c-a912-3aef0ab74dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801f6727-1101-433c-a912-3aef0ab74dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1471081298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dfb3fc3e22d48e7baa8fbf996986459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:44Z,use_quota=True,user_id='3374a516f4ca4c12b3cdf41183c9c1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df6a5cb-8505-4769-8cf9-50163db60b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df6a5cb-8505-4769-8cf9-50163db60b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89d9429-5a7f-400a-9163-34e57510547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89d9429-5a7f-400a-9163-34e57510547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac', 'volume_name': 'volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d0da1f-d474-4430-ab1d-cce22d413a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d0da1f-d474-4430-ab1d-cce22d413a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22ec433-16b0-4c68-9430-55dca5673fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:44 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume 0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac', 'volume_size': 1} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 1073741824" returned: 0 in 0.824s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] <== create_volume: return (989ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1471081298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dfb3fc3e22d48e7baa8fbf996986459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:44Z,use_quota=True,user_id='3374a516f4ca4c12b3cdf41183c9c1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Creating volume 0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:56:44 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:44 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=6, name=volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc1fa34-e840-416a-b277-37dcb8af84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa292c90-901e-41df-bf24-fd5a5a7e9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Volume volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 (d19e83f7-4eab-45b0-b999-15db2d7f5c42): created successfully Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa292c90-901e-41df-bf24-fd5a5a7e9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (3f7ca4f9-b5c0-45a8-b2c7-0ccbbaf83b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac 1073741824" returned: 0 in 0.567s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-da0d0f3d-8ae3-4201-89d5-a373c012c60b tempest-VolumesTestJSON-1943257682 None] Created volume successfully. Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" returned: 0 in 0.362s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] <== create_volume: return (957ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22ec433-16b0-4c68-9430-55dca5673fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef05edc-9e35-41f3-973e-bfc5d91df44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac (0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac): created successfully Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef05edc-9e35-41f3-973e-bfc5d91df44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Flow 'volume_create_manager' (e7accdc7-115c-4393-9a3b-8339bf9b3606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7e870b1f-e826-418a-a30e-95ea92344169 tempest-AttachSCSIVolumeTestJSON-868452423 None] Created volume successfully. Sep 16 12:56:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (39088489-60be-42d1-a05b-b3d42280de2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0b89d-6503-4d4d-af83-b553db153505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b0b89d-6503-4d4d-af83-b553db153505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1792435891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:46Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b22233-3b96-49b3-a6f7-7e51346c7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b22233-3b96-49b3-a6f7-7e51346c7b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708e8c8-5f7c-4ba6-8853-056124be4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5708e8c8-5f7c-4ba6-8853-056124be4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe', 'volume_name': 'volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f293149d-06ac-4730-94cd-50c72de1f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f293149d-06ac-4730-94cd-50c72de1f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc428ea-3681-4e0b-96bd-a48674de7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:46 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Volume 5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe', 'volume_size': 1} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1792435891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:46Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Creating volume 5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:56:46 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:56:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:46 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=7, name=volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe 1073741824" returned: 0 in 0.407s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" returned: 0 in 0.313s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc428ea-3681-4e0b-96bd-a48674de7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6908c861-cb20-4706-a6ba-8db3223a13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:47 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Volume volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe (5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe): created successfully Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6908c861-cb20-4706-a6ba-8db3223a13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (39088489-60be-42d1-a05b-b3d42280de2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5b7d22e4-7ba0-4665-8cf0-8744a2189b00 tempest-VolumesTestJSON-1943257682 None] Created volume successfully. Sep 16 12:56:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (0be95cc5-679c-4ff4-af15-4c8ad87c0635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dff34e-e0df-43fe-bd84-388008e97e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dff34e-e0df-43fe-bd84-388008e97e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218060844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625bc7d3-cd6c-4fff-8f02-94e151ed7555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:51Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17103144-86f0-4921-997b-c3d76d2c0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17103144-86f0-4921-997b-c3d76d2c0c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d3efb0-b295-43cf-ae09-425a5380dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d3efb0-b295-43cf-ae09-425a5380dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625bc7d3-cd6c-4fff-8f02-94e151ed7555', 'volume_name': 'volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96f006-b021-46bf-8269-d746ffcc64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96f006-b021-46bf-8269-d746ffcc64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1664dc7-429e-42a4-9241-f0927a56cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:51 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Volume 625bc7d3-cd6c-4fff-8f02-94e151ed7555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555', 'volume_size': 1} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1218060844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625bc7d3-cd6c-4fff-8f02-94e151ed7555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3c7ecd952e84669895fb5f0ebb6a005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:56:51Z,use_quota=True,user_id='b8bf50880dba44b086f082c673aeb8a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Creating volume 625bc7d3-cd6c-4fff-8f02-94e151ed7555 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:56:51 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:56:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:51 devstack quobyte-client[83541]: System call of process 85108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:56:51 devstack quobyte-client[83541]: System call of process 85108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:56:51 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=8, name=volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 1073741824" returned: 0 in 0.427s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555" returned: 0 in 0.199s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] <== create_volume: return (807ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1664dc7-429e-42a4-9241-f0927a56cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67192de-c640-484a-bfdc-2c1298ec1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:56:52 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Volume volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 (625bc7d3-cd6c-4fff-8f02-94e151ed7555): created successfully Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67192de-c640-484a-bfdc-2c1298ec1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:56:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Flow 'volume_create_manager' (0be95cc5-679c-4ff4-af15-4c8ad87c0635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:56:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8c364129-513c-491d-89cf-93da3ce9b7a3 tempest-VolumesTestJSON-1943257682 None] Created volume successfully. Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-625bc7d3-cd6c-4fff-8f02-94e151ed7555-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-625bc7d3-cd6c-4fff-8f02-94e151ed7555-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-quobyte-625bc7d3-cd6c-4fff-8f02-94e151ed7555" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-625bc7d3-cd6c-4fff-8f02-94e151ed7555" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603b743-bdfb-4856-a264-fa1544725be3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:56:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555" returned: 0 in 0.632s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-625bc7d3-cd6c-4fff-8f02-94e151ed7555" returned: 0 in 0.099s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-625bc7d3-cd6c-4fff-8f02-94e151ed7555" released by "delete_volume" :: held 0.969s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:55 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Created reservations ['41b36987-b97c-4d2f-a18d-83b1000cf477', 'ea925da0-f631-46c8-a7ba-ba9d92e8e0c0', '53ce46dc-9601-44f1-8259-5ca6ba030d82', '3b82e371-b886-41b0-bb96-2aa9b5503bc6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.113s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:56:56 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Deleted volume successfully. Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cfdd8d26-b3f7-4234-b0f6-71232917a424 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-625bc7d3-cd6c-4fff-8f02-94e151ed7555-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:56:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-quobyte-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:56:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" acquired by "delete_volume" :: waited 0.019s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:56:57 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd3799-538a-4a16-a83f-456d43207de8]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:56:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" returned: 0 in 0.786s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" returned: 0 in 0.535s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf0f61-5141-4396-855e-d44ae0ab0f59]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe" released by "delete_volume" :: held 1.683s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Created reservations ['4d87b1bf-7134-4590-8a39-09270cdb1d68', 'f7b42a3a-775b-4254-be0d-24e79d4320d3', '7592cc24-85c1-46da-a360-68692c0646fa', '4667fc81-5180-4505-af90-31328c78bfac'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" returned: 0 in 0.606s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.673s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.494s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0d4e55-77a1-4254-b95c-5fd12addc9e5]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:56:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.613s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Deleted volume successfully. Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd64e4a3c-7458-432f-8608-09b08beff23e', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 12:57:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b" returned: 0 in 0.646s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8ef3625-b88c-4015-8644-e49da3e33d51 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-5fc7d5f6-d1d2-496e-b1fa-ac110a1c2abe-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-b93141e2-96a4-4341-a03b-f81587c0cd89 req-2a2cce9e-dc7a-479f-bdf5-5c8d03ef30a7 tempest-AttachSCSIVolumeTestJSON-868452423 None] attachment_update completed successfully. Sep 16 12:57:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-9b700740-2784-4f91-9b34-50124f70a75b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77ec7fd7-c982-471e-bf7e-5463f0d20bb1', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 12:57:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-a9d4457b-831c-4277-b5b3-1e8aa40bbca0 req-4ea2acef-6b97-4957-a744-4a8f9626a1fe tempest-VolumesAssistedSnapshotsTest-721534254 None] attachment_update completed successfully. Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-d19e83f7-4eab-45b0-b999-15db2d7f5c42-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-d19e83f7-4eab-45b0-b999-15db2d7f5c42-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "cinder-quobyte-d19e83f7-4eab-45b0-b999-15db2d7f5c42" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-d19e83f7-4eab-45b0-b999-15db2d7f5c42" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe0287-0972-46ac-9430-d4337bbcdd7d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:01 devstack quobyte-client[83541]: System call of process 85159 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42" returned: 0 in 0.689s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d19e83f7-4eab-45b0-b999-15db2d7f5c42" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-quobyte-d19e83f7-4eab-45b0-b999-15db2d7f5c42" released by "delete_volume" :: held 1.093s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Created reservations ['9097a571-21ed-43cf-91ce-28195f12046b', '70fae68e-7a2c-4d88-9a29-82f7d62b8715', '1b45ef23-e9bc-4aba-ae0c-13a9f3c0ebfe', '7aafd5cf-1266-43c5-b57d-724aa80a5b67'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:03 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Deleted volume successfully. Sep 16 12:57:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3c70074d-e174-42c2-9961-70d97f8fbc04 tempest-VolumesTestJSON-1943257682 None] Lock "cinder-d19e83f7-4eab-45b0-b999-15db2d7f5c42-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:12 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=37,cinder:UPDATE=50,cinder:DELETE=3,cinder:INSERT=9 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:57:13 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=40,cinder:SELECT=35,cinder:DELETE=6,cinder:INSERT=7 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:57:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:57:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:57:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e3002b02-530c-45e2-8a09-d0452fa4b803 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e3002b02-530c-45e2-8a09-d0452fa4b803 tempest-GroupsTest-315701131 None] Group tempest-Group1-879976403: creating Sep 16 12:57:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e3002b02-530c-45e2-8a09-d0452fa4b803 tempest-GroupsTest-315701131 None] Group tempest-Group1-879976403: created successfully Sep 16 12:57:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e3002b02-530c-45e2-8a09-d0452fa4b803 tempest-GroupsTest-315701131 None] Create group completed successfully. Sep 16 12:57:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3eba5a76-38a8-4840-ad32-696096088388 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3eba5a76-38a8-4840-ad32-696096088388 tempest-GroupsTest-315701131 None] Group tempest-Group2-622968511: creating Sep 16 12:57:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3eba5a76-38a8-4840-ad32-696096088388 tempest-GroupsTest-315701131 None] Group tempest-Group2-622968511: created successfully Sep 16 12:57:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3eba5a76-38a8-4840-ad32-696096088388 tempest-GroupsTest-315701131 None] Create group completed successfully. Sep 16 12:57:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (423b5c17-7320-4054-801b-3624b47e8071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b72703-160f-4887-a685-47ef788ae2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b72703-160f-4887-a685-47ef788ae2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1475654357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90502232-bce9-442f-abf1-54abba451776,host='devstack@QuobyteHD#QuobyteHD',id=6366b7f0-d44c-469b-afa8-c4b13b612686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:27Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49373db9-4e57-46ab-bb1f-aa53d3dcf95c),volume_type_id=49373db9-4e57-46ab-bb1f-aa53d3dcf95c)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac185f1-6c9e-4300-8cc6-9618d09002dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac185f1-6c9e-4300-8cc6-9618d09002dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5368aa-6c24-43fb-a8c5-f4bff946face) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5368aa-6c24-43fb-a8c5-f4bff946face) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6366b7f0-d44c-469b-afa8-c4b13b612686', 'volume_name': 'volume-6366b7f0-d44c-469b-afa8-c4b13b612686', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e69c809-3fc5-4793-a5a3-24dacc48aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e69c809-3fc5-4793-a5a3-24dacc48aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7557481c-f2a8-44e4-84b5-e2df9058ae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Volume 6366b7f0-d44c-469b-afa8-c4b13b612686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6366b7f0-d44c-469b-afa8-c4b13b612686', 'volume_size': 1} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=90502232-bce9-442f-abf1-54abba451776,created_at=2025-09-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1475654357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90502232-bce9-442f-abf1-54abba451776,host='devstack@QuobyteHD#QuobyteHD',id=6366b7f0-d44c-469b-afa8-c4b13b612686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:27Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49373db9-4e57-46ab-bb1f-aa53d3dcf95c),volume_type_id=49373db9-4e57-46ab-bb1f-aa53d3dcf95c)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Creating volume 6366b7f0-d44c-469b-afa8-c4b13b612686 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:57:27 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:27 devstack quobyte-client[83541]: System call of process 85662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:57:27 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=9, name=volume-6366b7f0-d44c-469b-afa8-c4b13b612686, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686 1073741824" returned: 0 in 0.525s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686" returned: 0 in 0.064s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] <== create_volume: return (644ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:57:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7557481c-f2a8-44e4-84b5-e2df9058ae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6366b7f0-d44c-469b-afa8-c4b13b612686', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a313a62b-ae03-4438-a4a9-bccce893ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:28 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Volume volume-6366b7f0-d44c-469b-afa8-c4b13b612686 (6366b7f0-d44c-469b-afa8-c4b13b612686): created successfully Sep 16 12:57:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a313a62b-ae03-4438-a4a9-bccce893ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (423b5c17-7320-4054-801b-3624b47e8071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:28 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1cc7f92f-1ab7-43e5-bb08-1e1d0744c27c tempest-GroupsTest-315701131 None] Created volume successfully. Sep 16 12:57:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Acquiring lock "cinder-quobyte-6366b7f0-d44c-469b-afa8-c4b13b612686" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-6366b7f0-d44c-469b-afa8-c4b13b612686" acquired by "delete_volume" :: waited 0.039s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:29 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0087f-3d68-40ba-b8bb-139b8507472d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686" returned: 0 in 0.350s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6366b7f0-d44c-469b-afa8-c4b13b612686" returned: 0 in 0.072s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-6366b7f0-d44c-469b-afa8-c4b13b612686" released by "delete_volume" :: held 0.570s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Created reservations ['836cff09-cb78-40e3-8bd6-ef90a8ed27c7'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:30 devstack cinder-volume[83513]: WARNING cinder.quota [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1437445431 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1437445431, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:57:30 devstack cinder-volume[83513]: WARNING cinder.quota [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1437445431 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1437445431, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:57:30 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Created reservations ['82c2166b-f040-4854-bae6-851ed77aafb1', 'fbb19f3d-a595-4d0a-b19a-4633224bc9ea', '0d71a4f0-8b34-4d60-8e1b-745780a54019', '7a2d139d-b6fa-4dd2-9b71-f2d0935081a8'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.076s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:31 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-74eedf5a-c4ee-4201-9c09-16203c80cc4d tempest-GroupsTest-315701131 None] Delete group completed successfully. Sep 16 12:57:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-40a4a60b-c958-4f25-b9a0-83602704a1d6 req-3ec1bae6-3863-4b0d-b33a-134ad278547f tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-40a4a60b-c958-4f25-b9a0-83602704a1d6 req-3ec1bae6-3863-4b0d-b33a-134ad278547f tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-40a4a60b-c958-4f25-b9a0-83602704a1d6 req-3ec1bae6-3863-4b0d-b33a-134ad278547f tempest-VolumesAssistedSnapshotsTest-721534254 None] Terminate volume connection completed successfully. Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-40a4a60b-c958-4f25-b9a0-83602704a1d6 req-3ec1bae6-3863-4b0d-b33a-134ad278547f tempest-VolumesAssistedSnapshotsTest-721534254 None] Deleting attachment 77ec7fd7-c982-471e-bf7e-5463f0d20bb1. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 12:57:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-aedf6a66-5bdd-4de1-a8f1-215addea6ef7 req-53028b27-5cfb-4de2-85cf-6da94eff548c tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-aedf6a66-5bdd-4de1-a8f1-215addea6ef7 req-53028b27-5cfb-4de2-85cf-6da94eff548c tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-aedf6a66-5bdd-4de1-a8f1-215addea6ef7 req-53028b27-5cfb-4de2-85cf-6da94eff548c tempest-AttachSCSIVolumeTestJSON-868452423 None] Terminate volume connection completed successfully. Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-aedf6a66-5bdd-4de1-a8f1-215addea6ef7 req-53028b27-5cfb-4de2-85cf-6da94eff548c tempest-AttachSCSIVolumeTestJSON-868452423 None] Deleting attachment d64e4a3c-7458-432f-8608-09b08beff23e. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Created reservations ['1ce93d11-f085-48eb-b654-b57eb00aebbd'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.086s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:32 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-058f4aa7-330e-48f4-9def-2c216f000618 tempest-GroupsTest-315701131 None] Delete group completed successfully. Sep 16 12:57:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "cinder-9b700740-2784-4f91-9b34-50124f70a75b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "cinder-9b700740-2784-4f91-9b34-50124f70a75b-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f42a34a6-a9c5-4afd-b2d5-509e173e4f0b tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f42a34a6-a9c5-4afd-b2d5-509e173e4f0b tempest-GroupsTest-315701131 None] Group tempest-GroupsTest-Group-1855371225: creating Sep 16 12:57:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "cinder-quobyte-9b700740-2784-4f91-9b34-50124f70a75b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "cinder-quobyte-9b700740-2784-4f91-9b34-50124f70a75b" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f42a34a6-a9c5-4afd-b2d5-509e173e4f0b tempest-GroupsTest-315701131 None] Group tempest-GroupsTest-Group-1855371225: created successfully Sep 16 12:57:34 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b458365-5f58-4e5c-81e5-a7f17afa1e82]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f42a34a6-a9c5-4afd-b2d5-509e173e4f0b tempest-GroupsTest-315701131 None] Create group completed successfully. Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b" returned: 0 in 0.517s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9b700740-2784-4f91-9b34-50124f70a75b" returned: 0 in 0.115s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "cinder-quobyte-9b700740-2784-4f91-9b34-50124f70a75b" released by "delete_volume" :: held 0.806s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Created reservations ['dbecbd8a-2f54-4346-a3dc-4d1e5eba71f8', 'e1b0c708-08e4-4468-86f8-65c9b8eb3641', 'fa11467a-1b05-405f-b47b-b08258da33a4', '409d7c21-ba96-469a-80d8-b39bc72aa4c9'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.792s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:36 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Deleted volume successfully. Sep 16 12:57:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (841db623-459b-4019-8d5c-50f163b445f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2ec94-f0b0-4c46-8c48-9280a89ead20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2ec94-f0b0-4c46-8c48-9280a89ead20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1139908955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,host='devstack@QuobyteHD#QuobyteHD',id=a7b88cf3-da48-4f96-b354-498884310f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:36Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01ad033-1663-469d-9b1e-a563cf5da2fd),volume_type_id=a01ad033-1663-469d-9b1e-a563cf5da2fd)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd8d9f5-ddc7-4f02-8cc5-b59edc59bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd8d9f5-ddc7-4f02-8cc5-b59edc59bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb1dc6-8a7b-45d0-9900-3dde8769b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb1dc6-8a7b-45d0-9900-3dde8769b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b88cf3-da48-4f96-b354-498884310f8d', 'volume_name': 'volume-a7b88cf3-da48-4f96-b354-498884310f8d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b50fd30-6338-44df-adc1-cd45a89c822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b50fd30-6338-44df-adc1-cd45a89c822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd965a3f-f3e2-4eab-88d5-a481905ba18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Volume a7b88cf3-da48-4f96-b354-498884310f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b88cf3-da48-4f96-b354-498884310f8d', 'volume_size': 1} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,created_at=2025-09-16T10:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1139908955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,host='devstack@QuobyteHD#QuobyteHD',id=a7b88cf3-da48-4f96-b354-498884310f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:36Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01ad033-1663-469d-9b1e-a563cf5da2fd),volume_type_id=a01ad033-1663-469d-9b1e-a563cf5da2fd)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Creating volume a7b88cf3-da48-4f96-b354-498884310f8d {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:57:37 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:37 devstack quobyte-client[83541]: System call of process 85719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:57:37 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=10, name=volume-a7b88cf3-da48-4f96-b354-498884310f8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-57306b21-b97c-44f4-af15-d4f0185a28a5 tempest-VolumesAssistedSnapshotsTest-721534254 None] Lock "cinder-9b700740-2784-4f91-9b34-50124f70a75b-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d 1073741824" returned: 0 in 0.490s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d" returned: 0 in 0.166s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd965a3f-f3e2-4eab-88d5-a481905ba18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b88cf3-da48-4f96-b354-498884310f8d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa1bff3-b979-4803-a04b-555551ea61bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Volume volume-a7b88cf3-da48-4f96-b354-498884310f8d (a7b88cf3-da48-4f96-b354-498884310f8d): created successfully Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa1bff3-b979-4803-a04b-555551ea61bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (841db623-459b-4019-8d5c-50f163b445f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-043a7f12-d429-4b6e-9ab1-ca49fee1d9b5 tempest-GroupsTest-315701131 None] Created volume successfully. Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.340s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:41 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (71a5f0a7-f752-4d45-a597-a5e27aa89200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109e7440-6b8d-4992-8a11-e3c9cd7ccdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109e7440-6b8d-4992-8a11-e3c9cd7ccdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-20520859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,host='devstack@QuobyteHD#QuobyteHD',id=80dda61e-853f-4eec-a447-6a391bc6ff46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:41Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01ad033-1663-469d-9b1e-a563cf5da2fd),volume_type_id=a01ad033-1663-469d-9b1e-a563cf5da2fd)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf96f75e-bc06-4668-b74f-e586a6f2cadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf96f75e-bc06-4668-b74f-e586a6f2cadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f87197-30cf-43d6-a943-05703b068f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f87197-30cf-43d6-a943-05703b068f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dda61e-853f-4eec-a447-6a391bc6ff46', 'volume_name': 'volume-80dda61e-853f-4eec-a447-6a391bc6ff46', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528f2536-21c0-48e6-b01d-8258b11535ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528f2536-21c0-48e6-b01d-8258b11535ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b95051-33d6-4d4e-8057-bb071af6bbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:42 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Volume 80dda61e-853f-4eec-a447-6a391bc6ff46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dda61e-853f-4eec-a447-6a391bc6ff46', 'volume_size': 1} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,created_at=2025-09-16T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-20520859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67eff9cb-10fc-4ffb-84a5-60bf78395ed2,host='devstack@QuobyteHD#QuobyteHD',id=80dda61e-853f-4eec-a447-6a391bc6ff46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9c7acaf4334782a9be5cd8b4f61c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:57:41Z,use_quota=True,user_id='8c5f6f01b0a14b98a96fcae8d343e469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a01ad033-1663-469d-9b1e-a563cf5da2fd),volume_type_id=a01ad033-1663-469d-9b1e-a563cf5da2fd)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Creating volume 80dda61e-853f-4eec-a447-6a391bc6ff46 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:57:42 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:42 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=11, name=volume-80dda61e-853f-4eec-a447-6a391bc6ff46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46 1073741824" returned: 0 in 0.495s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46" returned: 0 in 0.190s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:57:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b95051-33d6-4d4e-8057-bb071af6bbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dda61e-853f-4eec-a447-6a391bc6ff46', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0904214f-7042-4aa7-bad4-2856d6e9ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:57:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Volume volume-80dda61e-853f-4eec-a447-6a391bc6ff46 (80dda61e-853f-4eec-a447-6a391bc6ff46): created successfully Sep 16 12:57:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0904214f-7042-4aa7-bad4-2856d6e9ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:57:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Flow 'volume_create_manager' (71a5f0a7-f752-4d45-a597-a5e27aa89200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:57:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a5c5f808-a9c5-45a5-aa4a-1d1dbac4e558 tempest-GroupsTest-315701131 None] Created volume successfully. Sep 16 12:57:45 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-38e49e79-3fab-4db3-ba2d-7f7e6b54f734 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-38e49e79-3fab-4db3-ba2d-7f7e6b54f734 tempest-GroupsTest-315701131 None] Update group completed successfully. Sep 16 12:57:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c7487f52-44ec-4d65-adb7-6a4a8ed35ef9 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c7487f52-44ec-4d65-adb7-6a4a8ed35ef9 tempest-GroupsTest-315701131 None] Update group completed successfully. Sep 16 12:57:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "cinder-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:48 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "cinder-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Acquiring lock "cinder-quobyte-80dda61e-853f-4eec-a447-6a391bc6ff46" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-80dda61e-853f-4eec-a447-6a391bc6ff46" acquired by "delete_volume" :: waited 0.031s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa97f19-aa89-4d97-8369-aec0fed8ed8b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:48 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "cinder-quobyte-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "cinder-quobyte-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" acquired by "delete_volume" :: waited 0.067s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[634aeff9-25f6-4458-974b-e3617827b172]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46" returned: 0 in 0.632s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-80dda61e-853f-4eec-a447-6a391bc6ff46" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-80dda61e-853f-4eec-a447-6a391bc6ff46" released by "delete_volume" :: held 0.921s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Acquiring lock "cinder-quobyte-a7b88cf3-da48-4f96-b354-498884310f8d" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-a7b88cf3-da48-4f96-b354-498884310f8d" acquired by "delete_volume" :: waited 0.041s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492b588-340e-4e35-a6bb-da76daf3de0e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" returned: 0 in 0.729s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" returned: 0 in 0.116s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "cinder-quobyte-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac" released by "delete_volume" :: held 1.023s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Created reservations ['ccfb52a7-ce28-4b72-b271-2b9d58da03f7', '91e5af3a-336b-442e-8632-20239334981b', '93909dfd-78f2-4d41-a079-ca06aadbcd4a', '9c30b335-27e3-4458-b04a-9ffc28507193'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d" returned: 0 in 0.800s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a7b88cf3-da48-4f96-b354-498884310f8d" returned: 0 in 0.222s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "cinder-quobyte-a7b88cf3-da48-4f96-b354-498884310f8d" released by "delete_volume" :: held 1.177s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Created reservations ['685d19c5-95f0-4a5e-997a-ba7f166db6e3'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.332s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Deleted volume successfully. Sep 16 12:57:51 devstack cinder-volume[83513]: WARNING cinder.quota [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1472622983 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1472622983, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:57:51 devstack cinder-volume[83513]: WARNING cinder.quota [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1472622983 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1472622983, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79e484bb-27c1-41d5-ad30-d5f84d44bccd tempest-AttachSCSIVolumeTestJSON-868452423 None] Lock "cinder-0b94bd06-bfa2-470b-9bb5-b44fb6cb79ac-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Created reservations ['f6c02c0a-2c90-4438-bbba-ff32fe3ce37e', 'cacd21ce-d1d6-464b-b0ae-691202b0e6ba', '0a5bf555-68a0-430e-b76f-3536043f6919', '331e6439-d38d-4995-835c-71ef48b15c7c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Created reservations ['8c2b1e18-fa06-41df-a65f-b0927b17a0fd', '25b1e3e2-f1bd-4b34-807d-5eb1911482fb', '93c7de5b-ed8d-4b5a-a7c8-5ebca5a772ad', 'e0f03b8f-a75f-4a23-8af5-f839e620915f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:57:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:57:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.143s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:57:52 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:57:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-928656da-5af4-422e-b614-275c0f4a20d2 tempest-GroupsTest-315701131 None] Delete group completed successfully. Sep 16 12:58:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=40,cinder:UPDATE=65,cinder:DELETE=1,cinder:INSERT=7 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:58:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=64,cinder:UPDATE=52,cinder:INSERT=16,cinder:DELETE=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:58:05 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Flow 'volume_create_manager' (bd2a14d4-3064-4696-be2b-456138a6c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7eae87-17be-416f-83d0-3397571afa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7eae87-17be-416f-83d0-3397571afa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-34764439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a25436-ff65-4fbd-b1a4-680c42a281de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d38bb04edb64a2ca288f12e6e0f8e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:58:05Z,use_quota=True,user_id='861dbaa3cf88410aa65405ddbe42b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee97a15f-94b1-48b3-acad-dcaaf868c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee97a15f-94b1-48b3-acad-dcaaf868c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1ca6ae-e14a-4b83-a8a1-4abb5c0a538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1ca6ae-e14a-4b83-a8a1-4abb5c0a538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a25436-ff65-4fbd-b1a4-680c42a281de', 'volume_name': 'volume-79a25436-ff65-4fbd-b1a4-680c42a281de', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ec45ca-a9af-4bdc-88f5-f350711df491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ec45ca-a9af-4bdc-88f5-f350711df491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570cbcbf-338f-49ed-b1a7-47962e4a7ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:05 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Volume 79a25436-ff65-4fbd-b1a4-680c42a281de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a25436-ff65-4fbd-b1a4-680c42a281de', 'volume_size': 1} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-34764439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a25436-ff65-4fbd-b1a4-680c42a281de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d38bb04edb64a2ca288f12e6e0f8e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:58:05Z,use_quota=True,user_id='861dbaa3cf88410aa65405ddbe42b7d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Creating volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:58:05 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:58:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:05 devstack quobyte-client[83541]: System call of process 85800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:05 devstack quobyte-client[83541]: System call of process 85800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:05 devstack quobyte-client[83541]: System call of process 85800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:05 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=12, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de 1073741824" returned: 0 in 0.424s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de" returned: 0 in 0.149s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570cbcbf-338f-49ed-b1a7-47962e4a7ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a25436-ff65-4fbd-b1a4-680c42a281de', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1d9af9-82de-4953-a7b1-f8db932a94f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Volume volume-79a25436-ff65-4fbd-b1a4-680c42a281de (79a25436-ff65-4fbd-b1a4-680c42a281de): created successfully Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1d9af9-82de-4953-a7b1-f8db932a94f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Flow 'volume_create_manager' (bd2a14d4-3064-4696-be2b-456138a6c14a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:58:06 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2dacf766-be5f-41a1-8d6f-c8ff26d04eba tempest-SnapshotsActionsTest-2091051469 None] Created volume successfully. Sep 16 12:58:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Creating offline snapshot 55643e4f-5d47-4cc1-b3e7-585b9f91adf7 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c43f90-472d-4dfe-a859-e77f68e1247e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de" returned: 0 in 0.579s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=13, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 1G" returned: 0 in 0.283s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.213s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.137s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.info" returned: 0 in 0.122s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.info" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2f6381a4-fd54-4bdd-a2e9-7bd7ab0ef956 tempest-SnapshotsActionsTest-2091051469 None] Create snapshot completed successfully Sep 16 12:58:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Creating offline snapshot 121e4000-aba8-490d-9bc2-a524593960fd of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:58:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d01816-df6d-4f6f-9e34-30c4ab3176b1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.661s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:14 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=15, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd 1G" returned: 0 in 0.450s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.201s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.161s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:15 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-38948be9-44f0-4294-8598-ece0f15b159e tempest-SnapshotsActionsTest-2091051469 None] Create snapshot completed successfully Sep 16 12:58:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-121e4000-aba8-490d-9bc2-a524593960fd-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-121e4000-aba8-490d-9bc2-a524593960fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:18 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-121e4000-aba8-490d-9bc2-a524593960fd" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-121e4000-aba8-490d-9bc2-a524593960fd" acquired by "_delete_snapshot" :: waited 0.192s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Deleting offline snapshot 121e4000-aba8-490d-9bc2-a524593960fd of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] snapshot_file for this snap is: volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[29605656-40d2-4ada-826f-7606da23a8db]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.656s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2377161a-d677-4755-b5cc-256e3ae281da]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.526s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:19 devstack quobyte-client[83541]: System call of process 85874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.378s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.121e4000-aba8-490d-9bc2-a524593960fd" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-121e4000-aba8-490d-9bc2-a524593960fd" released by "_delete_snapshot" :: held 2.057s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_snapshot" :: held 2.266s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:20 devstack cinder-volume[83513]: WARNING cinder.quota [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Created reservations ['5d10684e-4af8-4422-89a2-d5c42d683daa', '57a7c2ab-cec1-4f92-8984-037c46ca263b', 'f8cb5b4a-3412-4fc0-9b73-a5990926cdd4', 'a02d44ab-0417-4551-a1a9-f6bd2d0a4656'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Delete snapshot completed successfully. Sep 16 12:58:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b89b0dd9-67ac-4cff-9250-9176367222f3 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-121e4000-aba8-490d-9bc2-a524593960fd-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:21 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Creating offline snapshot 40a9fcc0-5473-4116-b3b1-17a8342d2d12 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:58:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e8db8-bc7d-49c1-9e19-5ad439c022f9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.493s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:22 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=16, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 1G" returned: 0 in 0.323s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:22 devstack quobyte-client[83541]: System call of process 85885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.216s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.539s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:23 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ae49e0ea-a675-4b3a-9ce1-deaf00cc7d57 tempest-SnapshotsActionsTest-2091051469 None] Create snapshot completed successfully Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-40a9fcc0-5473-4116-b3b1-17a8342d2d12-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-40a9fcc0-5473-4116-b3b1-17a8342d2d12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-40a9fcc0-5473-4116-b3b1-17a8342d2d12" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-40a9fcc0-5473-4116-b3b1-17a8342d2d12" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Deleting offline snapshot 40a9fcc0-5473-4116-b3b1-17a8342d2d12 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] snapshot_file for this snap is: volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[18feedec-9605-462f-8216-f103afaeda0e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.412s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea580a3-e1c1-4cba-a9c8-3a5e52d1e269]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.470s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.331s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.40a9fcc0-5473-4116-b3b1-17a8342d2d12" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-40a9fcc0-5473-4116-b3b1-17a8342d2d12" released by "_delete_snapshot" :: held 1.694s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_snapshot" :: held 1.733s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:26 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Created reservations ['4f8b5c8c-4b18-43df-9770-312499dd251f', '566bc6b0-c52e-42ef-b17e-e03c218cc454', '89de28f5-10f1-454d-8b30-15c79de11007', '89d18162-efd1-45b5-9c24-e7a7348ed2e6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Delete snapshot completed successfully. Sep 16 12:58:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6a43b448-8a0e-416c-8713-9b1618019948 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-40a9fcc0-5473-4116-b3b1-17a8342d2d12-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:28 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Creating offline snapshot 94856cf0-6ea5-444e-afe6-b20a921880c0 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c0f116-5a94-4b32-b50c-d423f8378d25]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.629s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:29 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=17, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 1G" returned: 0 in 0.408s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:29 devstack quobyte-client[83541]: System call of process 85907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 0.188s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 0.119s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:58:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-70aa3017-517d-48ee-b2c8-190edbb8b8c6 tempest-SnapshotsActionsTest-2091051469 None] Create snapshot completed successfully Sep 16 12:58:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-94856cf0-6ea5-444e-afe6-b20a921880c0-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-94856cf0-6ea5-444e-afe6-b20a921880c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.160s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-94856cf0-6ea5-444e-afe6-b20a921880c0" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-94856cf0-6ea5-444e-afe6-b20a921880c0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Deleting offline snapshot 94856cf0-6ea5-444e-afe6-b20a921880c0 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] snapshot_file for this snap is: volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8054eb7-a35a-4672-9af4-dc75c0c95b46]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:33 devstack quobyte-client[83541]: System call of process 85912 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 1.048s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:33 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3fdcbf-7df9-44fa-86db-8bbe9f7d4271]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.785s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:34 devstack quobyte-client[83541]: System call of process 85919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 0.490s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.94856cf0-6ea5-444e-afe6-b20a921880c0" returned: 0 in 0.163s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-94856cf0-6ea5-444e-afe6-b20a921880c0" released by "_delete_snapshot" :: held 3.024s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_snapshot" :: held 3.082s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:35 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Created reservations ['159ab4f1-58e5-423a-b5ac-ad65a9af193b', '1e0793ba-b38f-4178-b8cb-b93616291e68', 'fb4cab4c-986a-426a-93eb-144d395d489d', 'b1edd473-4647-496d-bbd5-603697c52da4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Delete snapshot completed successfully. Sep 16 12:58:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-29a83611-4ebb-499d-8769-e5073857d1d0 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-94856cf0-6ea5-444e-afe6-b20a921880c0-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Creating offline snapshot def612c3-f6ef-4357-9031-96b641f9aa9d of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172d42e-9da0-48f4-8bec-b4c0ad29101d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:37 devstack quobyte-client[83541]: System call of process 85925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.612s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:37 devstack quobyte-client[83541]: System call of process 85928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:38 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=18, name=volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d 1G" returned: 0 in 0.373s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img rebase -u -b volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.235s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.162s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.142s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-242bc1a6-6573-4197-aeaa-6d17a4a6a63f tempest-SnapshotsActionsTest-2091051469 None] Create snapshot completed successfully Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.172s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-def612c3-f6ef-4357-9031-96b641f9aa9d-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-def612c3-f6ef-4357-9031-96b641f9aa9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:40 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Acquiring lock "cinder-quobyte-def612c3-f6ef-4357-9031-96b641f9aa9d" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-def612c3-f6ef-4357-9031-96b641f9aa9d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Deleting offline snapshot def612c3-f6ef-4357-9031-96b641f9aa9d of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] snapshot_file for this snap is: volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443d13c-ad6f-4996-a349-68620164bf1a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.627s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:41 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f77156-7dce-412a-a727-51e87587d288]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:42 devstack quobyte-client[83541]: System call of process 85940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.590s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.326s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.def612c3-f6ef-4357-9031-96b641f9aa9d" returned: 0 in 0.174s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-def612c3-f6ef-4357-9031-96b641f9aa9d" released by "_delete_snapshot" :: held 2.063s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_snapshot" :: held 2.095s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:43 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Created reservations ['fd63e3cc-b511-4152-972a-2def9f35c44b', '95c9da10-1c19-4477-8e75-610b42fa6ea6', '8afc1145-a015-47d2-83ef-4a784737aeec', '46cf74b7-f76a-4936-b098-9543a630c6e2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Delete snapshot completed successfully. Sep 16 12:58:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-afaf165e-731d-4b04-8245-10a795120277 tempest-SnapshotsActionsTest-709805846 None] Lock "cinder-def612c3-f6ef-4357-9031-96b641f9aa9d-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "cinder-55643e4f-5d47-4cc1-b3e7-585b9f91adf7-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-55643e4f-5d47-4cc1-b3e7-585b9f91adf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "cinder-quobyte-55643e4f-5d47-4cc1-b3e7-585b9f91adf7" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-55643e4f-5d47-4cc1-b3e7-585b9f91adf7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Deleting offline snapshot 55643e4f-5d47-4cc1-b3e7-585b9f91adf7 of volume 79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] snapshot_file for this snap is: volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d52eec2-1f53-4360-882a-e9bcd377bc54]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.525s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79a25436-ff65-4fbd-b1a4-680c42a281de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:58:45 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170e700-b948-4cc1-bbc0-e8a3c20b3a41]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:45 devstack quobyte-client[83541]: System call of process 85952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:58:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de" returned: 0 in 0.548s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.343s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de.55643e4f-5d47-4cc1-b3e7-585b9f91adf7" returned: 0 in 0.124s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-55643e4f-5d47-4cc1-b3e7-585b9f91adf7" released by "_delete_snapshot" :: held 2.021s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_snapshot" :: held 2.057s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:47 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Created reservations ['1081a4c4-c6ed-4410-a685-b0de3bb9c8fc', 'c5d75036-171e-4c02-9ebc-d19247734377', '477d25aa-9bdc-41d7-b277-4759a871cf9e', '31d73c5a-1737-457e-9205-7e64282030b9'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Delete snapshot completed successfully. Sep 16 12:58:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2dafa6d7-8055-420e-9492-0a430b8b453b tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-55643e4f-5d47-4cc1-b3e7-585b9f91adf7-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "cinder-79a25436-ff65-4fbd-b1a4-680c42a281de-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-79a25436-ff65-4fbd-b1a4-680c42a281de-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:48 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" acquired by "delete_volume" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2a0d1-3abf-4cd2-865b-ff4a138f1d58]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de" returned: 0 in 0.527s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-79a25436-ff65-4fbd-b1a4-680c42a281de" returned: 0 in 0.110s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-quobyte-79a25436-ff65-4fbd-b1a4-680c42a281de" released by "delete_volume" :: held 0.875s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Created reservations ['0f7d0742-639a-4c01-ab2d-8bb5447b9fc9', '26716939-29e4-4274-b96c-e83dfa7fc714', '2662f851-db6c-4e90-84eb-cc0f2d604fdc', 'ec068efc-736d-43cb-9cba-c9fe73863e14'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.092s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:58:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Deleted volume successfully. Sep 16 12:58:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-949d9fc1-76a5-4ee3-837b-b458e952ba47 tempest-SnapshotsActionsTest-2091051469 None] Lock "cinder-79a25436-ff65-4fbd-b1a4-680c42a281de-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:58:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:58:56 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Flow 'volume_create_manager' (2feb8ece-84df-42c8-a302-669ae7b982dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe28bc30-036f-4bf3-93bf-ef41f1debfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe28bc30-036f-4bf3-93bf-ef41f1debfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-306470702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaca962-3d5d-4615-8acb-8ad73009c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8201f1011a3046e3a1d0c30cb42128db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:58:57Z,use_quota=True,user_id='4306f50d18a146a3a524c4e92ed9da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ba64db-07b8-429f-8f8e-82c3d2207a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ba64db-07b8-429f-8f8e-82c3d2207a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f0f94-940a-4088-bdad-0e6fc14b2467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f0f94-940a-4088-bdad-0e6fc14b2467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbaca962-3d5d-4615-8acb-8ad73009c010', 'volume_name': 'volume-dbaca962-3d5d-4615-8acb-8ad73009c010', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab7c62-d987-4582-977e-e66eeda0911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab7c62-d987-4582-977e-e66eeda0911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3255781f-5b04-459b-92c6-3abac4fde36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:57 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Volume dbaca962-3d5d-4615-8acb-8ad73009c010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbaca962-3d5d-4615-8acb-8ad73009c010', 'volume_size': 1} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-306470702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaca962-3d5d-4615-8acb-8ad73009c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8201f1011a3046e3a1d0c30cb42128db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:58:57Z,use_quota=True,user_id='4306f50d18a146a3a524c4e92ed9da06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Creating volume dbaca962-3d5d-4615-8acb-8ad73009c010 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:58:57 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:57 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=19, name=volume-dbaca962-3d5d-4615-8acb-8ad73009c010, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 1073741824" returned: 0 in 0.439s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010" returned: 0 in 0.147s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:58:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:58:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3255781f-5b04-459b-92c6-3abac4fde36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaca962-3d5d-4615-8acb-8ad73009c010', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e683968-abac-4ba9-8788-56d97219e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:58:58 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Volume volume-dbaca962-3d5d-4615-8acb-8ad73009c010 (dbaca962-3d5d-4615-8acb-8ad73009c010): created successfully Sep 16 12:58:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e683968-abac-4ba9-8788-56d97219e247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:58:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Flow 'volume_create_manager' (2feb8ece-84df-42c8-a302-669ae7b982dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:58:58 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-032d9326-cee4-4b27-9a8f-ca634b0f2b0e tempest-TaggedAttachmentsTest-784775850 None] Created volume successfully. Sep 16 12:59:08 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=35,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:59:08 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=49,cinder:DELETE=7,cinder:SELECT=39,cinder:INSERT=15 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 12:59:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Flow 'volume_create_manager' (788763a4-755c-485c-a456-a7d29b335f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b34f47-a1cf-4f1b-b97b-e000191b2ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b34f47-a1cf-4f1b-b97b-e000191b2ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-457509170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5765d70c-5312-49ad-a754-35f307a59b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4447d7bd2546b1a5f859adc8ea82a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:59:17Z,use_quota=True,user_id='7389f23799bb47b9b3c07b2216c1de4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c86c88-ad6d-492f-a2c3-cf1a1b576e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c86c88-ad6d-492f-a2c3-cf1a1b576e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d563911-fc7b-4f43-aff8-b3f0ecc10982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d563911-fc7b-4f43-aff8-b3f0ecc10982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5765d70c-5312-49ad-a754-35f307a59b5c', 'volume_name': 'volume-5765d70c-5312-49ad-a754-35f307a59b5c', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd72e976-20dc-47da-bf9b-4cc74432fed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd72e976-20dc-47da-bf9b-4cc74432fed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43a5b38-fbeb-4e94-b25d-5d4beb8a3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:17 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Volume 5765d70c-5312-49ad-a754-35f307a59b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5765d70c-5312-49ad-a754-35f307a59b5c', 'volume_size': 1} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-457509170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5765d70c-5312-49ad-a754-35f307a59b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4447d7bd2546b1a5f859adc8ea82a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:59:17Z,use_quota=True,user_id='7389f23799bb47b9b3c07b2216c1de4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Creating volume 5765d70c-5312-49ad-a754-35f307a59b5c {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:59:17 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:59:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:18 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=20, name=volume-5765d70c-5312-49ad-a754-35f307a59b5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:59:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c 1073741824" returned: 0 in 0.877s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c" returned: 0 in 0.231s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] <== create_volume: return (1430ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:59:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43a5b38-fbeb-4e94-b25d-5d4beb8a3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5765d70c-5312-49ad-a754-35f307a59b5c', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eb9a69-c04c-48f4-934e-1fdcb13b602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:20 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Volume volume-5765d70c-5312-49ad-a754-35f307a59b5c (5765d70c-5312-49ad-a754-35f307a59b5c): created successfully Sep 16 12:59:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eb9a69-c04c-48f4-934e-1fdcb13b602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Flow 'volume_create_manager' (788763a4-755c-485c-a456-a7d29b335f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:59:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bc147330-4a8d-4237-a04a-8a19021708de tempest-DeleteServersTestJSON-110959727 None] Created volume successfully. Sep 16 12:59:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c283d87-88da-48f3-94d6-d94149c2ddf1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:29 devstack quobyte-client[83541]: System call of process 86151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:29 devstack quobyte-client[83541]: System call of process 86151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:29 devstack quobyte-client[83541]: System call of process 86151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c" returned: 0 in 2.083s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.201s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-5765d70c-5312-49ad-a754-35f307a59b5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9910f61-fad3-4b8e-a6b3-fdffe9839004', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 12:59:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:29 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-f8f0a569-6389-4307-8f82-e4678106d783 req-35850597-564e-4a80-b454-79dcad823acc tempest-DeleteServersTestJSON-110959727 None] attachment_update completed successfully. Sep 16 12:59:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Flow 'volume_create_manager' (676af3cb-da5d-4730-8ada-c92a31332a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36ee9ec-11b0-4751-840c-b0be799e141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36ee9ec-11b0-4751-840c-b0be799e141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-678523886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d671dbd-367a-451d-ac1e-fb27ac251e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6af43077ee4cff8f9430bf3f9faa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:59:33Z,use_quota=True,user_id='383a8a823e2042cea2978a3c774cb3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad96816-df50-4d9f-8dd2-a7cb00d589cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad96816-df50-4d9f-8dd2-a7cb00d589cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a5eb3b-025f-4a37-93b6-2b32d1c42da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a5eb3b-025f-4a37-93b6-2b32d1c42da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d671dbd-367a-451d-ac1e-fb27ac251e68', 'volume_name': 'volume-2d671dbd-367a-451d-ac1e-fb27ac251e68', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbd7c6d-6fd8-4c69-8c41-b226bc5f6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbd7c6d-6fd8-4c69-8c41-b226bc5f6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d35628-aa73-417b-84c9-f2947c9ab759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume 2d671dbd-367a-451d-ac1e-fb27ac251e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d671dbd-367a-451d-ac1e-fb27ac251e68', 'volume_size': 1} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T10:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-678523886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d671dbd-367a-451d-ac1e-fb27ac251e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6af43077ee4cff8f9430bf3f9faa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T10:59:33Z,use_quota=True,user_id='383a8a823e2042cea2978a3c774cb3d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Creating volume 2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 12:59:34 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 12:59:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=21, name=volume-2d671dbd-367a-451d-ac1e-fb27ac251e68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:59:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 1073741824" returned: 0 in 1.305s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68" returned: 0 in 0.193s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] <== create_volume: return (1707ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 12:59:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d35628-aa73-417b-84c9-f2947c9ab759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d671dbd-367a-451d-ac1e-fb27ac251e68', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce3819b-6627-4ff6-ab60-c44621cd8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 12:59:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 (2d671dbd-367a-451d-ac1e-fb27ac251e68): created successfully Sep 16 12:59:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce3819b-6627-4ff6-ab60-c44621cd8663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 12:59:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Flow 'volume_create_manager' (676af3cb-da5d-4730-8ada-c92a31332a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 12:59:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b9dbc0b9-40e2-45e9-b334-1a2d5e1372c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Created volume successfully. Sep 16 12:59:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Creating offline snapshot bed374ea-cf58-49b9-aa9c-11ac5f677cc2 of volume 2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 12:59:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff2f2cb-a13a-436f-8f6b-17053806ed0f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:40 devstack quobyte-client[83541]: System call of process 86615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68" returned: 0 in 1.322s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=22, name=volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 1G" returned: 0 in 0.557s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.451s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:59:41 devstack quobyte-client[83541]: System call of process 86627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "qemu-img rebase -u -b volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 0.368s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 0.143s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 0.115s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.info" returned: 0 in 0.166s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 12:59:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.info" returned: 0 in 0.236s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-eb69305e-3516-4071-b4fd-f6dab03eca3a tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Create snapshot completed successfully Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "cinder-bed374ea-cf58-49b9-aa9c-11ac5f677cc2-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-bed374ea-cf58-49b9-aa9c-11ac5f677cc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "cinder-quobyte-bed374ea-cf58-49b9-aa9c-11ac5f677cc2" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-bed374ea-cf58-49b9-aa9c-11ac5f677cc2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Deleting offline snapshot bed374ea-cf58-49b9-aa9c-11ac5f677cc2 of volume 2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] snapshot_file for this snap is: volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f544cb4b-f7d3-46c3-bf50-8d4881948cce]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:47 devstack quobyte-client[83541]: System call of process 86707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 1.005s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d671dbd-367a-451d-ac1e-fb27ac251e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 12:59:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3aaa5b-7cb7-414e-acfe-90fa1dbc9665]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:48 devstack quobyte-client[83541]: System call of process 86710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68" returned: 0 in 0.829s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:49 devstack quobyte-client[83541]: System call of process 86713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 0.356s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68.bed374ea-cf58-49b9-aa9c-11ac5f677cc2" returned: 0 in 0.163s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-bed374ea-cf58-49b9-aa9c-11ac5f677cc2" released by "_delete_snapshot" :: held 2.975s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" released by "delete_snapshot" :: held 3.029s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:50 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Created reservations ['2b21d823-d923-47bd-b9a5-c13140f0d757', '29cebd0c-0689-4120-96fa-ee9a80f11e90', '8bb0372d-7c76-4bb6-aa05-007c2e8d618e', '3ac6ce67-1f58-40a8-88a0-0c21ef40b171'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:59:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Delete snapshot completed successfully. Sep 16 12:59:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1d324008-f27e-41ed-b977-c622773999ae tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-bed374ea-cf58-49b9-aa9c-11ac5f677cc2-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-38b664e1-518b-4e9b-8755-5dee3bc7aaa6 req-c975fd75-4bb3-442d-b0ab-2b8ecf20b513 tempest-DeleteServersTestJSON-110959727 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-38b664e1-518b-4e9b-8755-5dee3bc7aaa6 req-c975fd75-4bb3-442d-b0ab-2b8ecf20b513 tempest-DeleteServersTestJSON-110959727 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-38b664e1-518b-4e9b-8755-5dee3bc7aaa6 req-c975fd75-4bb3-442d-b0ab-2b8ecf20b513 tempest-DeleteServersTestJSON-110959727 None] Terminate volume connection completed successfully. Sep 16 12:59:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-38b664e1-518b-4e9b-8755-5dee3bc7aaa6 req-c975fd75-4bb3-442d-b0ab-2b8ecf20b513 tempest-DeleteServersTestJSON-110959727 None] Deleting attachment a9910f61-fad3-4b8e-a6b3-fdffe9839004. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "cinder-2d671dbd-367a-451d-ac1e-fb27ac251e68-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-2d671dbd-367a-451d-ac1e-fb27ac251e68-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b623a0-2506-4894-8f2d-76bc3e292c17]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68" returned: 0 in 0.458s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2d671dbd-367a-451d-ac1e-fb27ac251e68" returned: 0 in 0.157s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-quobyte-2d671dbd-367a-451d-ac1e-fb27ac251e68" released by "delete_volume" :: held 0.847s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Created reservations ['c6930cb8-c021-4ffa-af5a-d8b367891d1f', '21a15efc-744d-404f-9b1f-eb6d493a44bd', '3c1fec2d-0a15-4d2f-898b-a62293f23911', 'd02fa98c-d2ac-43d1-8139-43f907587dda'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:52 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:59:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Deleted volume successfully. Sep 16 12:59:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e97d3c30-fbce-4fcf-9548-3e2e1b3f2b01 tempest-VolumeSnapshotQuotasNegativeTestJSON-345345366 None] Lock "cinder-2d671dbd-367a-451d-ac1e-fb27ac251e68-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "cinder-5765d70c-5312-49ad-a754-35f307a59b5c-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "cinder-5765d70c-5312-49ad-a754-35f307a59b5c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:55 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "cinder-quobyte-5765d70c-5312-49ad-a754-35f307a59b5c" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "cinder-quobyte-5765d70c-5312-49ad-a754-35f307a59b5c" acquired by "delete_volume" :: waited 0.025s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4ab29d-be83-4aad-a627-175e8bf21869]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c" returned: 0 in 0.670s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5765d70c-5312-49ad-a754-35f307a59b5c" returned: 0 in 0.118s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "cinder-quobyte-5765d70c-5312-49ad-a754-35f307a59b5c" released by "delete_volume" :: held 1.034s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Created reservations ['4901920f-0955-4cc6-90f0-94b373cdc61b', '0b0de19b-c467-492d-9a79-33fd3bd2ed23', 'fd05bbf3-9f1c-4af4-a9f3-51bec770cfa8', '96178507-1d90-4273-b05b-dd2d5bdd4b99'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.140s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 12:59:56 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 12:59:56 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Deleted volume successfully. Sep 16 12:59:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f549de89-54d7-4796-a411-ff30fe606ca9 tempest-DeleteServersTestJSON-110959727 None] Lock "cinder-5765d70c-5312-49ad-a754-35f307a59b5c-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:00:06 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=40,cinder:SELECT=26,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:00:07 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=10,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.233s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:00:41 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:00:41 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:00:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (40ac6edd-5414-4af0-a56e-ddaff30aeb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:00:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a94c1b-380f-404c-8f1c-f96353e6fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a94c1b-380f-404c-8f1c-f96353e6fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-889352413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd8dd1b-5a02-4d6d-b182-eca954aaefc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:00:41Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ef859b-6d13-49a8-9d5e-f8af0fc402e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ef859b-6d13-49a8-9d5e-f8af0fc402e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf13911e-2bae-4a65-bf19-c222f589823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:42 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:00:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf13911e-2bae-4a65-bf19-c222f589823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fd8dd1b-5a02-4d6d-b182-eca954aaefc1', 'volume_name': 'volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac490797-9822-4cd4-a9b1-5b00dfbb21f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac490797-9822-4cd4-a9b1-5b00dfbb21f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecca0c7a-1ec0-4350-b4da-5ee11bf162a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 13:00:43 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Cloning 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:00:44 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD, size 20.69 MB, duration 1.44 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:00:44 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Image download 20.69 MB at 14.39 MB/s Sep 16 13:00:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64c5df1-d7c3-4b3b-a4be-fb3973628842]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:00:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:45 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD Sep 16 13:00:45 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:00:47 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Sep 16 13:00:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD" returned: 0 in 2.737s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:47 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 is fetched for user b78a2c4560f343a19fa02223983e9978. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:00:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc50dc1-7504-403e-ba97-7870499f1264]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:00:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:48 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD Sep 16 13:00:48 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:00:50 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD" returned: 0 in 2.735s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-889352413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd8dd1b-5a02-4d6d-b182-eca954aaefc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:00:41Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Creating volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:00:50 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:00:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:51 devstack quobyte-client[83541]: System call of process 86839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:00:51 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=24, name=volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 1073741824" returned: 0 in 0.474s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 0.120s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:00:51 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Attempting download of 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:00:52 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa6ca3-d742-4cea-aae9-600be8af64cd]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:00:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_mgirhzo8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_mgirhzo8" returned: 0 in 0.474s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_mgirhzo8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_mgirhzo8" returned: 1 in 0.537s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_mgirhzo8' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cfa2c-2876-4876-8754-740277d8dd01]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 was qcow2, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:00:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:53 devstack quobyte-client[83541]: System call of process 86851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:00:53 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=24, name=volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 1.358s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_knre_xivdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:00:55 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Converted 112.00 MB image at 80.41 MB/s Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:55 devstack quobyte-client[83541]: System call of process 86859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 1G" returned: 0 in 0.262s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a255b7-a0e4-4d67-a005-33d54dcb1084]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:00:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 0.426s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:56 devstack quobyte-client[83541]: System call of process 86865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 1 in 0.556s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Downloaded image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 for user b78a2c4560f343a19fa02223983e9978 is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Marking volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Copying metadata from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 to 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:00:56 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Creating volume glance metadata for volume 2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 backed by image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:00:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecca0c7a-1ec0-4350-b4da-5ee11bf162a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbe96bd-daba-46e0-931e-1e175d14db3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:57 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Volume volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 (2fd8dd1b-5a02-4d6d-b182-eca954aaefc1): created successfully Sep 16 13:00:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbe96bd-daba-46e0-931e-1e175d14db3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (40ac6edd-5414-4af0-a56e-ddaff30aeb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:00:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2d7bbcea-071e-4ae2-b00b-13743f8768bf tempest-TaggedBootDevicesTest-1991235254 None] Created volume successfully. Sep 16 13:00:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (7ad19ea9-ff3c-4a67-a882-af0eb72d7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348b6d21-298b-4201-8d5e-30f41ce7dbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348b6d21-298b-4201-8d5e-30f41ce7dbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1046133593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8e52ff-55d1-409a-9b2b-ba7646c185cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:00:58Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318af809-126e-4812-84da-eedf4edcd343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318af809-126e-4812-84da-eedf4edcd343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f490f7-64f6-4d99-8376-1fd256ad4b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f490f7-64f6-4d99-8376-1fd256ad4b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8e52ff-55d1-409a-9b2b-ba7646c185cf', 'volume_name': 'volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c1711-d371-4c0e-a1be-5d58e1064d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c1711-d371-4c0e-a1be-5d58e1064d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9180f33-ea06-497a-9081-12e6b6d575df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:58 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Volume 5c8e52ff-55d1-409a-9b2b-ba7646c185cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf', 'volume_size': 1} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1046133593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8e52ff-55d1-409a-9b2b-ba7646c185cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:00:58Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Creating volume 5c8e52ff-55d1-409a-9b2b-ba7646c185cf {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:00:58 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:00:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:58 devstack quobyte-client[83541]: System call of process 86868 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:00:59 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=25, name=volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf 1073741824" returned: 0 in 0.502s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" returned: 0 in 0.169s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9180f33-ea06-497a-9081-12e6b6d575df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a8ec03-c2bc-451d-bf57-bd790786e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:00:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Volume volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf (5c8e52ff-55d1-409a-9b2b-ba7646c185cf): created successfully Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a8ec03-c2bc-451d-bf57-bd790786e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:00:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (7ad19ea9-ff3c-4a67-a882-af0eb72d7958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:00:59 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6f467c58-ccc2-4960-b14c-2982766a393c tempest-TaggedBootDevicesTest-1991235254 None] Created volume successfully. Sep 16 13:01:02 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (3e2134a7-5eb6-496d-b0ae-92f2e14bd524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5083f109-a108-4c1a-a74f-155856b66981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5083f109-a108-4c1a-a74f-155856b66981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-27622325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d715ae6-8dae-4369-88d5-1a756017b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:02Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c995c49-1f3f-4a78-85d3-62b5c3b0550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c995c49-1f3f-4a78-85d3-62b5c3b0550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5ba65e-e520-455c-a6b1-683cdbfb633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5ba65e-e520-455c-a6b1-683cdbfb633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d715ae6-8dae-4369-88d5-1a756017b888', 'volume_name': 'volume-3d715ae6-8dae-4369-88d5-1a756017b888', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e6325c-70d0-484f-b88c-b1c23a911d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e6325c-70d0-484f-b88c-b1c23a911d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edac85b8-457b-47b9-9e23-9337d2d45f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Volume 3d715ae6-8dae-4369-88d5-1a756017b888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d715ae6-8dae-4369-88d5-1a756017b888', 'volume_size': 1} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-27622325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d715ae6-8dae-4369-88d5-1a756017b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f22ea3691c473a9397d887163104b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:02Z,use_quota=True,user_id='b78a2c4560f343a19fa02223983e9978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Creating volume 3d715ae6-8dae-4369-88d5-1a756017b888 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:01:02 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:01:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:03 devstack quobyte-client[83541]: System call of process 86913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:01:03 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=26, name=volume-3d715ae6-8dae-4369-88d5-1a756017b888, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:01:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 1073741824" returned: 0 in 0.651s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888" returned: 0 in 0.347s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] <== create_volume: return (1238ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edac85b8-457b-47b9-9e23-9337d2d45f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d715ae6-8dae-4369-88d5-1a756017b888', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa7caa5-f91e-463d-a340-c713cc19f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:04 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Volume volume-3d715ae6-8dae-4369-88d5-1a756017b888 (3d715ae6-8dae-4369-88d5-1a756017b888): created successfully Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa7caa5-f91e-463d-a340-c713cc19f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Flow 'volume_create_manager' (3e2134a7-5eb6-496d-b0ae-92f2e14bd524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-11347bc4-92f9-47da-b175-aae7e45d91e8 tempest-TaggedBootDevicesTest-1991235254 None] Created volume successfully. Sep 16 13:01:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7cf3d9-b0f8-4f54-8b63-a83930127ab6]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010" returned: 0 in 0.666s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-dbaca962-3d5d-4615-8acb-8ad73009c010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d137674-784d-4f60-a063-d741aa0b5110', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:01:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-fba41ac5-1c0b-4013-b715-87a4e8328b67 req-a1a33335-1c0a-416e-bcb6-27d233f57540 tempest-TaggedAttachmentsTest-784775850 None] attachment_update completed successfully. Sep 16 13:01:22 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=11,cinder:SELECT=16,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:01:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:01:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (6623755c-ec37-4202-b27d-8f64ba769f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cc858-4f50-41c7-94eb-98b2f5989da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6cc858-4f50-41c7-94eb-98b2f5989da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2061056263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd164a2-ada2-4632-9f1a-1595527f3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:26Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40910768-abbf-4a61-8a69-6408e086ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40910768-abbf-4a61-8a69-6408e086ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba74c23-824f-4dcb-a859-392c429287cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba74c23-824f-4dcb-a859-392c429287cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd164a2-ada2-4632-9f1a-1595527f3d91', 'volume_name': 'volume-0fd164a2-ada2-4632-9f1a-1595527f3d91', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dc7658-9945-4c24-8a61-75f7da3095d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dc7658-9945-4c24-8a61-75f7da3095d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569edd55-24dd-4ae6-9785-11a3b5dbf895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:26 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Volume 0fd164a2-ada2-4632-9f1a-1595527f3d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd164a2-ada2-4632-9f1a-1595527f3d91', 'volume_size': 1} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2061056263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd164a2-ada2-4632-9f1a-1595527f3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:26Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Creating volume 0fd164a2-ada2-4632-9f1a-1595527f3d91 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:01:26 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:26 devstack quobyte-client[83541]: System call of process 87496 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:01:26 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=27, name=volume-0fd164a2-ada2-4632-9f1a-1595527f3d91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 1073741824" returned: 0 in 0.638s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569edd55-24dd-4ae6-9785-11a3b5dbf895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd164a2-ada2-4632-9f1a-1595527f3d91', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecea1553-003e-4ab9-931d-d30f82fbd913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Volume volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 (0fd164a2-ada2-4632-9f1a-1595527f3d91): created successfully Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecea1553-003e-4ab9-931d-d30f82fbd913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (6623755c-ec37-4202-b27d-8f64ba769f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:27 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f3840834-cab9-462e-897d-b366147e3979 tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:01:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91" by "attach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91" acquired by "attach_volume" :: waited 0.135s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:28 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:28 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Attaching volume 0fd164a2-ada2-4632-9f1a-1595527f3d91 to instance 1d024a44-1d47-44ae-840c-0b41a0042af5 at mountpoint /dev/vdb on host None. Sep 16 13:01:28 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Attach volume completed successfully. Sep 16 13:01:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ed87cbc-24d1-47a0-a8a1-4318cdec7992 tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91" released by "attach_volume" :: held 0.551s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Terminate volume connection completed successfully. Sep 16 13:01:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" by "detach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Detaching volume 0fd164a2-ada2-4632-9f1a-1595527f3d91 from instance 1d024a44-1d47-44ae-840c-0b41a0042af5. Sep 16 13:01:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Detach volume completed successfully. Sep 16 13:01:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fb2b0e6d-7576-476d-99d8-dc020801bacf tempest-VolumesActionsTest-1474836915 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1954809d-4d76-4481-9c8a-7f61bb25cd7c tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" by "detach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1954809d-4d76-4481-9c8a-7f61bb25cd7c tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1954809d-4d76-4481-9c8a-7f61bb25cd7c tempest-VolumesActionsTest-386362947 None] Volume detach called, but volume not attached. Sep 16 13:01:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1954809d-4d76-4481-9c8a-7f61bb25cd7c tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-detach_volume" released by "detach_volume" :: held 0.015s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-quobyte-0fd164a2-ada2-4632-9f1a-1595527f3d91" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "cinder-quobyte-0fd164a2-ada2-4632-9f1a-1595527f3d91" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[03953b3d-0483-4f00-8fc5-af16175d7a53]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91" returned: 0 in 0.517s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fd164a2-ada2-4632-9f1a-1595527f3d91" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "cinder-quobyte-0fd164a2-ada2-4632-9f1a-1595527f3d91" released by "delete_volume" :: held 0.910s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Created reservations ['6f1d4bc0-952b-4ec0-b973-16813ed77ba4', '8456f473-3e92-494a-b1c6-8a7c445a5700', '27c04a35-31b9-4b8a-b8b2-8c321acc7900', '30c0803c-8d19-4467-b786-eb2f40e0ddad'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.216s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:34 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:01:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Deleted volume successfully. Sep 16 13:01:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6a65355-a6a7-48cd-b7a5-36e4e8585290 tempest-VolumesActionsTest-386362947 None] Lock "cinder-0fd164a2-ada2-4632-9f1a-1595527f3d91-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[898528ec-7f8a-48c8-894d-e811b42811a9]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.275s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:01:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 0.778s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 1 in 0.716s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:01:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.645s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe294cc1-35a6-4527-8f99-161684f37fbd', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:01:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-dd07ced6-e416-4851-b527-f2171a8c579f tempest-TaggedBootDevicesTest-1991235254 None] attachment_update completed successfully. Sep 16 13:01:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (f839ae09-5dc3-4ef9-b438-a1ce18f8b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b15528a-c225-4b8d-bb66-81e62caf80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b15528a-c225-4b8d-bb66-81e62caf80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454332300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad565125-4116-4a0f-93c3-916ac46384ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:45Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa291d-7e4c-410e-b6d1-7fd6ab5d5058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6aa291d-7e4c-410e-b6d1-7fd6ab5d5058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7658ee-1686-4657-bb4d-78ca10916910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7658ee-1686-4657-bb4d-78ca10916910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad565125-4116-4a0f-93c3-916ac46384ff', 'volume_name': 'volume-ad565125-4116-4a0f-93c3-916ac46384ff', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ddd58-a07b-4f15-87fc-a17592f48704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ddd58-a07b-4f15-87fc-a17592f48704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2873b50e-18b1-4647-bf2e-a23905760ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Volume ad565125-4116-4a0f-93c3-916ac46384ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad565125-4116-4a0f-93c3-916ac46384ff', 'volume_size': 1} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454332300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad565125-4116-4a0f-93c3-916ac46384ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:45Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Creating volume ad565125-4116-4a0f-93c3-916ac46384ff {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:01:45 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:45 devstack quobyte-client[83541]: System call of process 87600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:01:45 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=28, name=volume-ad565125-4116-4a0f-93c3-916ac46384ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff 1073741824" returned: 0 in 0.716s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff" returned: 0 in 0.171s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.378s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50f45c4-2587-4db9-9016-d3fabee5668d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2873b50e-18b1-4647-bf2e-a23905760ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad565125-4116-4a0f-93c3-916ac46384ff', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a06117c-1ab4-4f21-bfb5-10252b65f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:46 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Volume volume-ad565125-4116-4a0f-93c3-916ac46384ff (ad565125-4116-4a0f-93c3-916ac46384ff): created successfully Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a06117c-1ab4-4f21-bfb5-10252b65f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (f839ae09-5dc3-4ef9-b438-a1ce18f8b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7acde489-aaf4-401f-8131-8fef1631ef53 tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" returned: 0 in 0.573s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.621s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14660766-d6a8-4499-b7c9-8c297e8cccb8', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:01:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-ad565125-4116-4a0f-93c3-916ac46384ff-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-ad565125-4116-4a0f-93c3-916ac46384ff-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-afdbd7ea-4ead-43cc-bf9b-a03c2d481257 tempest-TaggedBootDevicesTest-1991235254 None] attachment_update completed successfully. Sep 16 13:01:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-quobyte-ad565125-4116-4a0f-93c3-916ac46384ff" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-ad565125-4116-4a0f-93c3-916ac46384ff" acquired by "delete_volume" :: waited 0.010s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041f828-bb08-4952-b6af-ae716239bc19]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff" returned: 0 in 0.528s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ad565125-4116-4a0f-93c3-916ac46384ff" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-ad565125-4116-4a0f-93c3-916ac46384ff" released by "delete_volume" :: held 0.810s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Created reservations ['b4ffa7f5-eb96-487c-a2ad-b2d70ca08e23', '52df605a-d96b-4301-a60f-a6f7055fd309', '7366cbd9-5e1f-465f-9785-ad0725737136', '136e7251-85ba-4cdf-85a8-0fa02239c2c5'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.135s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:49 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:01:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Deleted volume successfully. Sep 16 13:01:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc459192-e7a1-4d37-b06e-332f5782bf21 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-ad565125-4116-4a0f-93c3-916ac46384ff-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:50 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (12ba7eba-0f01-4683-83bb-ae9c4d94245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daf4189-aaab-4144-adc3-86c595461213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[531aa8f0-2ce9-443e-ab90-0d86c757a3f7]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-602f07ad-74c3-4697-804a-5da614456bc2 req-731d3550-7453-4942-9663-351f48e70933 tempest-TaggedAttachmentsTest-784775850 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9daf4189-aaab-4144-adc3-86c595461213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213980806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff6f3b3-f4e4-4654-8791-f3fe02833891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:50Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36586151-b218-4b9c-a8b7-abd17f028217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36586151-b218-4b9c-a8b7-abd17f028217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59a5518-6ca5-4c2b-a213-506fd64d6024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59a5518-6ca5-4c2b-a213-506fd64d6024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff6f3b3-f4e4-4654-8791-f3fe02833891', 'volume_name': 'volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe52bed-97fe-402b-af83-898eb4954a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe52bed-97fe-402b-af83-898eb4954a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6251912a-4379-489c-b4d3-97cc079f5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:51 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Volume 9ff6f3b3-f4e4-4654-8791-f3fe02833891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891', 'volume_size': 1} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-602f07ad-74c3-4697-804a-5da614456bc2 req-731d3550-7453-4942-9663-351f48e70933 tempest-TaggedAttachmentsTest-784775850 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-602f07ad-74c3-4697-804a-5da614456bc2 req-731d3550-7453-4942-9663-351f48e70933 tempest-TaggedAttachmentsTest-784775850 None] Terminate volume connection completed successfully. Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-602f07ad-74c3-4697-804a-5da614456bc2 req-731d3550-7453-4942-9663-351f48e70933 tempest-TaggedAttachmentsTest-784775850 None] Deleting attachment 5d137674-784d-4f60-a063-d741aa0b5110. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888" returned: 0 in 0.699s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213980806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff6f3b3-f4e4-4654-8791-f3fe02833891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:01:50Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Creating volume 9ff6f3b3-f4e4-4654-8791-f3fe02833891 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:01:51 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:01:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:52 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=29, name=volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:01:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-3d715ae6-8dae-4369-88d5-1a756017b888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a832f5d3-9d4e-4b21-a9a9-16a3feb1352a', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:01:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 1073741824" returned: 0 in 0.723s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891" returned: 0 in 0.574s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] <== create_volume: return (1335ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:53 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-185bab0e-76b6-4e8a-8d8b-4f720fc446b8 req-90a9f881-5670-40d0-bcf1-6dfce2e5cc31 tempest-TaggedBootDevicesTest-1991235254 None] attachment_update completed successfully. Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6251912a-4379-489c-b4d3-97cc079f5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724b1309-9e3a-4d02-8933-d2d188ac8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:01:53 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Volume volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 (9ff6f3b3-f4e4-4654-8791-f3fe02833891): created successfully Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724b1309-9e3a-4d02-8933-d2d188ac8126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (12ba7eba-0f01-4683-83bb-ae9c4d94245f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:01:53 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-19124b09-6b14-4404-be53-bf0193417c09 tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-9ff6f3b3-f4e4-4654-8791-f3fe02833891-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-9ff6f3b3-f4e4-4654-8791-f3fe02833891-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:53 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:01:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-quobyte-9ff6f3b3-f4e4-4654-8791-f3fe02833891" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:01:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-9ff6f3b3-f4e4-4654-8791-f3fe02833891" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:01:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd29b46d-ecd5-436f-b3dc-dce054831244]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:01:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:55 devstack quobyte-client[83541]: System call of process 87640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:01:55 devstack quobyte-client[83541]: System call of process 87640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:01:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891" returned: 0 in 1.333s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ff6f3b3-f4e4-4654-8791-f3fe02833891" returned: 0 in 0.444s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-9ff6f3b3-f4e4-4654-8791-f3fe02833891" released by "delete_volume" :: held 2.906s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:01:57 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Created reservations ['2a2fba66-f03d-427d-b95c-9e8b57ab43ea', '551a0f02-d67e-438b-b9b8-1b1a0a6f3e73', '13029db6-f32a-436c-b28f-4f7afa5e99c3', 'e65f4967-1ce5-463c-9f9c-74656156323e'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.243s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:01:58 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Deleted volume successfully. Sep 16 13:01:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6de28135-f90b-428d-867f-509eba4b8871 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-9ff6f3b3-f4e4-4654-8791-f3fe02833891-delete_volume" released by "delete_volume" :: held 5.034s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (5eccbe4e-3ab2-456a-a2f1-b6a69e927e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a03aa2-1f7c-4726-8e5d-281cf619229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a03aa2-1f7c-4726-8e5d-281cf619229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298007366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2563ac9c-9aef-472b-8ee2-14affc9cfa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:00Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd28cb0-8daa-4e6d-8324-fe08e34601f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd28cb0-8daa-4e6d-8324-fe08e34601f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0945536a-ec03-4f5c-bbaa-495056dc1e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0945536a-ec03-4f5c-bbaa-495056dc1e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2563ac9c-9aef-472b-8ee2-14affc9cfa85', 'volume_name': 'volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a840d8e8-aa8f-4708-ae4c-f2d67ba5f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a840d8e8-aa8f-4708-ae4c-f2d67ba5f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148e6b4-41c5-4f82-a804-45cf7ad36431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:00 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Volume 2563ac9c-9aef-472b-8ee2-14affc9cfa85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85', 'volume_size': 1} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298007366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2563ac9c-9aef-472b-8ee2-14affc9cfa85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:00Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Creating volume 2563ac9c-9aef-472b-8ee2-14affc9cfa85 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:02:00 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:00 devstack quobyte-client[83541]: System call of process 87668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:02:00 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=30, name=volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 1073741824" returned: 0 in 0.427s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85" returned: 0 in 0.225s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3148e6b4-41c5-4f82-a804-45cf7ad36431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518bcf3d-bcc7-432f-a2fc-8cf193918632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:01 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Volume volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 (2563ac9c-9aef-472b-8ee2-14affc9cfa85): created successfully Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518bcf3d-bcc7-432f-a2fc-8cf193918632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (5eccbe4e-3ab2-456a-a2f1-b6a69e927e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0c671c9c-5116-4bfc-8e75-2748866ca3f8 tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-2563ac9c-9aef-472b-8ee2-14affc9cfa85-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "cinder-2563ac9c-9aef-472b-8ee2-14affc9cfa85-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:02 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-quobyte-2563ac9c-9aef-472b-8ee2-14affc9cfa85" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-2563ac9c-9aef-472b-8ee2-14affc9cfa85" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13009e4-a5e8-4d91-8356-d7f39c855a94]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:02:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85" returned: 0 in 0.627s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2563ac9c-9aef-472b-8ee2-14affc9cfa85" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-2563ac9c-9aef-472b-8ee2-14affc9cfa85" released by "delete_volume" :: held 0.920s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Created reservations ['49178443-650e-4a52-abd1-ac8cd58446eb', '935f5ba1-a1f5-40b7-aceb-83fe0d776779', 'e47b0748-192f-40fe-9a23-7bda2314f0ba', 'fc7aa957-c622-4b79-8fa2-9618e164c753'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.140s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:04 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:02:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Deleted volume successfully. Sep 16 13:02:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-10f97b7d-a737-4d34-8ca8-e1fd7c10039e tempest-VolumesActionsTest-1474836915 None] Lock "cinder-2563ac9c-9aef-472b-8ee2-14affc9cfa85-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (23b3c102-8c44-472c-8044-135ef9f12dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a039a8f1-09ac-4390-83fd-62159f53ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a039a8f1-09ac-4390-83fd-62159f53ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377500208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d847fff-7b9c-4a31-abc5-01554b82b641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:06Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05826f5e-6121-4cb0-98e2-2d4213d9a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05826f5e-6121-4cb0-98e2-2d4213d9a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553661d8-f347-4eb5-a134-504943ba74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553661d8-f347-4eb5-a134-504943ba74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d847fff-7b9c-4a31-abc5-01554b82b641', 'volume_name': 'volume-7d847fff-7b9c-4a31-abc5-01554b82b641', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af9d70-6eac-4dbe-808a-8c93ff135412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6af9d70-6eac-4dbe-808a-8c93ff135412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7fcce6-b2e2-48c5-9dd3-1223b50a1593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Volume 7d847fff-7b9c-4a31-abc5-01554b82b641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d847fff-7b9c-4a31-abc5-01554b82b641', 'volume_size': 1} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377500208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d847fff-7b9c-4a31-abc5-01554b82b641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:06Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Creating volume 7d847fff-7b9c-4a31-abc5-01554b82b641 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:02:06 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:06 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=31, name=volume-7d847fff-7b9c-4a31-abc5-01554b82b641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641 1073741824" returned: 0 in 0.366s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641" returned: 0 in 0.078s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] <== create_volume: return (506ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.517s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7fcce6-b2e2-48c5-9dd3-1223b50a1593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d847fff-7b9c-4a31-abc5-01554b82b641', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9542df26-7ebd-4484-8071-14e90977a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Volume volume-7d847fff-7b9c-4a31-abc5-01554b82b641 (7d847fff-7b9c-4a31-abc5-01554b82b641): created successfully Sep 16 13:02:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9542df26-7ebd-4484-8071-14e90977a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (23b3c102-8c44-472c-8044-135ef9f12dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-73b28fd7-b708-472b-b741-3820fee9c81b tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-7d847fff-7b9c-4a31-abc5-01554b82b641-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-7d847fff-7b9c-4a31-abc5-01554b82b641-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "cinder-quobyte-7d847fff-7b9c-4a31-abc5-01554b82b641" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-7d847fff-7b9c-4a31-abc5-01554b82b641" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ae1111-0615-4f2d-afee-e84ee5e8c81d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:02:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641" returned: 0 in 0.547s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d847fff-7b9c-4a31-abc5-01554b82b641" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-quobyte-7d847fff-7b9c-4a31-abc5-01554b82b641" released by "delete_volume" :: held 0.833s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:09 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Created reservations ['497afe3b-a68f-4d9a-9af8-de9455b306f6', '1c75ee87-f067-4cd0-9ec4-83875434bde8', 'f50eaba5-c68e-43ae-9d3d-ef7f22a38ad5', '930e8e5a-1370-4d42-9d13-031fa1292076'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.116s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:02:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Deleted volume successfully. Sep 16 13:02:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-08aeae0c-62b9-4c9d-987b-b57cdacdf303 tempest-VolumesActionsTest-1474836915 None] Lock "cinder-7d847fff-7b9c-4a31-abc5-01554b82b641-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (d7bbb1e9-c786-4d57-85fc-2be4d9becc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f540ae-d684-4dd9-981e-122c7275d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f540ae-d684-4dd9-981e-122c7275d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541416696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:11Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a41a7-3ca5-4119-8586-6523af3db886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a41a7-3ca5-4119-8586-6523af3db886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b26ca0-db84-4df9-8f71-10dbd9af14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b26ca0-db84-4df9-8f71-10dbd9af14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab', 'volume_name': 'volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3671f5a-0c79-4dab-8d6c-e75456350406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3671f5a-0c79-4dab-8d6c-e75456350406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ab1bac-9ac4-4bb4-984f-84fd14992d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:11 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Volume 87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab', 'volume_size': 1} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541416696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70dc52eba4bc46f5be141ba735ba85a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:11Z,use_quota=True,user_id='408f872ab7b64f119a2001ea07723e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Creating volume 87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:02:11 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:11 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=32, name=volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab 1073741824" returned: 0 in 0.311s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" returned: 0 in 0.114s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ab1bac-9ac4-4bb4-984f-84fd14992d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c5f9d0-cce6-412e-9146-b6b6b37b2382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:12 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Volume volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab (87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab): created successfully Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c5f9d0-cce6-412e-9146-b6b6b37b2382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Flow 'volume_create_manager' (d7bbb1e9-c786-4d57-85fc-2be4d9becc54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-22afcb06-5928-47d5-98bf-24047f6fe6a9 tempest-VolumesActionsTest-386362947 None] Created volume successfully. Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "cinder-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:14 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Acquiring lock "cinder-quobyte-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "cinder-quobyte-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774014d-c99e-47e1-8758-703efdb29064]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:02:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" returned: 0 in 0.551s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" returned: 0 in 0.197s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "cinder-quobyte-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab" released by "delete_volume" :: held 1.076s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Created reservations ['a87bf937-78e2-4519-92df-f45317c79490', 'fcdc4e26-2785-487d-a0f5-38bc2eabf880', 'ca8af8f3-1036-4423-a437-a4c8e26ca473', '08e26a22-5324-48c2-a2c2-8696123fd221'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.519s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:17 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:02:17 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Deleted volume successfully. Sep 16 13:02:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-315c2252-b7ef-492f-8ff9-5d2f605ddef3 tempest-VolumesActionsTest-386362947 None] Lock "cinder-87616f2d-e5f8-4c2a-85b6-d5cf7d3191ab-delete_volume" released by "delete_volume" :: held 3.957s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:26 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=59,cinder:UPDATE=72,cinder:DELETE=7,cinder:INSERT=11 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:02:28 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=64,cinder:SELECT=63,cinder:INSERT=15,cinder:DELETE=5 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.251s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:02:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "cinder-dbaca962-3d5d-4615-8acb-8ad73009c010-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "cinder-dbaca962-3d5d-4615-8acb-8ad73009c010-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "cinder-quobyte-dbaca962-3d5d-4615-8acb-8ad73009c010" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:02:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "cinder-quobyte-dbaca962-3d5d-4615-8acb-8ad73009c010" acquired by "delete_volume" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:02:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89b4b2-d34a-49b2-a5d7-edc9e1a1f8a8]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:02:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010" returned: 0 in 0.619s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dbaca962-3d5d-4615-8acb-8ad73009c010" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "cinder-quobyte-dbaca962-3d5d-4615-8acb-8ad73009c010" released by "delete_volume" :: held 1.015s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Created reservations ['4ed181e9-611d-40ef-8496-3cf789114858', '3124ce55-ce24-4d7e-baf7-d08f148545d4', 'cbcd933f-b8d4-4109-8429-e29a20ff1191', '99d84bfb-f675-49b5-b10c-b1bc2ae33b25'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:57 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:02:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Deleted volume successfully. Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9abbc655-a634-4ade-aa36-b950204da132 tempest-TaggedAttachmentsTest-784775850 None] Lock "cinder-dbaca962-3d5d-4615-8acb-8ad73009c010-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:02:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (decc8cbc-d83d-423a-a3b9-07be9e8851e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa67224-1d86-40b1-b23d-671a4181fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa67224-1d86-40b1-b23d-671a4181fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353893080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a48b10f-423f-451e-b2d0-f882db77c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:59Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b4824c-40a8-472b-8e99-1eafe3952fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b4824c-40a8-472b-8e99-1eafe3952fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d31c2-a8fd-4bc4-951f-063237d80d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07d31c2-a8fd-4bc4-951f-063237d80d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a48b10f-423f-451e-b2d0-f882db77c42b', 'volume_name': 'volume-6a48b10f-423f-451e-b2d0-f882db77c42b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36eb97-14d2-447f-a761-73337ac9315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36eb97-14d2-447f-a761-73337ac9315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974e54e-f3ae-4a82-9c6b-792bcf5d4ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:02:58 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Volume 6a48b10f-423f-451e-b2d0-f882db77c42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a48b10f-423f-451e-b2d0-f882db77c42b', 'volume_size': 1} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-353893080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a48b10f-423f-451e-b2d0-f882db77c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:02:59Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Creating volume 6a48b10f-423f-451e-b2d0-f882db77c42b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:02:58 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:02:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:59 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=33, name=volume-6a48b10f-423f-451e-b2d0-f882db77c42b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b 1073741824" returned: 0 in 0.431s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b" returned: 0 in 0.162s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] <== create_volume: return (705ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974e54e-f3ae-4a82-9c6b-792bcf5d4ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a48b10f-423f-451e-b2d0-f882db77c42b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:02:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f90c4f6-1334-4c46-b6b2-b2e4af94f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:00 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Volume volume-6a48b10f-423f-451e-b2d0-f882db77c42b (6a48b10f-423f-451e-b2d0-f882db77c42b): created successfully Sep 16 13:03:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f90c4f6-1334-4c46-b6b2-b2e4af94f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (decc8cbc-d83d-423a-a3b9-07be9e8851e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b0575e8c-4f8e-4d87-bb95-00c3f959137c tempest-VolumesListAdminTestJSON-526157357 None] Created volume successfully. Sep 16 13:03:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:01 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:03:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (aaa058f4-9088-4a59-b0c4-655630d07bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c2d6db-49d2-4ec6-80a4-b4cfca338db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c2d6db-49d2-4ec6-80a4-b4cfca338db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2659615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4b9efd-827b-4480-b55e-62acd5d40739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:02Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5533a2-fdcd-43ef-b677-0d3c683e466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5533a2-fdcd-43ef-b677-0d3c683e466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c9765-3e17-43e0-ac72-77d5ae65cba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38c9765-3e17-43e0-ac72-77d5ae65cba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4b9efd-827b-4480-b55e-62acd5d40739', 'volume_name': 'volume-1d4b9efd-827b-4480-b55e-62acd5d40739', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82845cf1-fb5c-41f6-ae29-ac14ba2774b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82845cf1-fb5c-41f6-ae29-ac14ba2774b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbc51d0-becb-4099-a16a-e6a4ceb40416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Volume 1d4b9efd-827b-4480-b55e-62acd5d40739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4b9efd-827b-4480-b55e-62acd5d40739', 'volume_size': 1} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2659615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4b9efd-827b-4480-b55e-62acd5d40739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:02Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Creating volume 1d4b9efd-827b-4480-b55e-62acd5d40739 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:03:02 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:02 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=34, name=volume-1d4b9efd-827b-4480-b55e-62acd5d40739, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739 1073741824" returned: 0 in 0.475s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:03:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbc51d0-becb-4099-a16a-e6a4ceb40416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4b9efd-827b-4480-b55e-62acd5d40739', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adda4f57-2dee-4ccd-81f6-e24fd04913a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:03 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Volume volume-1d4b9efd-827b-4480-b55e-62acd5d40739 (1d4b9efd-827b-4480-b55e-62acd5d40739): created successfully Sep 16 13:03:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adda4f57-2dee-4ccd-81f6-e24fd04913a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (aaa058f4-9088-4a59-b0c4-655630d07bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cea4f0a2-ab5b-46aa-a67e-26b1908cfbc4 tempest-VolumesListAdminTestJSON-526157357 None] Created volume successfully. Sep 16 13:03:05 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (368fd8d5-0360-4173-96d5-b886d296e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2830f44-4db5-415b-9742-7ec051beb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2830f44-4db5-415b-9742-7ec051beb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-507422421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5da47b5-939a-4473-abb0-385675f588d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:05Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff58e8d-709c-4c8f-b3db-a22fdcef174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff58e8d-709c-4c8f-b3db-a22fdcef174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf83d9d-5aa2-403a-bd78-aa51232e0a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf83d9d-5aa2-403a-bd78-aa51232e0a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5da47b5-939a-4473-abb0-385675f588d6', 'volume_name': 'volume-e5da47b5-939a-4473-abb0-385675f588d6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a608c035-357e-44e2-8fc7-7ec361c0821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a608c035-357e-44e2-8fc7-7ec361c0821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f341431b-46c3-43dd-b6d4-86a92d29d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:05 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Volume e5da47b5-939a-4473-abb0-385675f588d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5da47b5-939a-4473-abb0-385675f588d6', 'volume_size': 1} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-507422421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5da47b5-939a-4473-abb0-385675f588d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2217c613624660b4d461363f0088f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:05Z,use_quota=True,user_id='f4ea6368e7d14e31a8f96aabbffa2bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Creating volume e5da47b5-939a-4473-abb0-385675f588d6 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:03:05 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:03:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:05 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=35, name=volume-e5da47b5-939a-4473-abb0-385675f588d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6 1073741824" returned: 0 in 0.632s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6" returned: 0 in 0.252s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] <== create_volume: return (1013ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f341431b-46c3-43dd-b6d4-86a92d29d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5da47b5-939a-4473-abb0-385675f588d6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0575bf07-6a30-444b-8cf9-97c2323e493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Volume volume-e5da47b5-939a-4473-abb0-385675f588d6 (e5da47b5-939a-4473-abb0-385675f588d6): created successfully Sep 16 13:03:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0575bf07-6a30-444b-8cf9-97c2323e493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Flow 'volume_create_manager' (368fd8d5-0360-4173-96d5-b886d296e90d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-166e0a5c-7ca6-4329-b74d-9a560e93ce4f tempest-VolumesListAdminTestJSON-526157357 None] Created volume successfully. Sep 16 13:03:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Flow 'volume_create_manager' (5cc4ed1c-ed81-4c17-8301-a598f11945a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9477af-5c5c-4205-8f11-38d669769ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9477af-5c5c-4205-8f11-38d669769ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0980db8e-2438-44c3-a8c1-c62a28f92b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2dc576c509042549f9583a9a7664d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:08Z,use_quota=True,user_id='acb9d45376cd421b80cc02c7300a34f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fae5c7-536b-4349-b16d-3caa95f2e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fae5c7-536b-4349-b16d-3caa95f2e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a407d548-99aa-4c2c-9a97-1d192ffd1f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a407d548-99aa-4c2c-9a97-1d192ffd1f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0980db8e-2438-44c3-a8c1-c62a28f92b49', 'volume_name': 'volume-0980db8e-2438-44c3-a8c1-c62a28f92b49', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b3e9e-743f-45d0-8253-9fd31f2b962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199b3e9e-743f-45d0-8253-9fd31f2b962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53daa944-fd69-4d13-9a03-e4cb715c392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Volume 0980db8e-2438-44c3-a8c1-c62a28f92b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0980db8e-2438-44c3-a8c1-c62a28f92b49', 'volume_size': 1} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0980db8e-2438-44c3-a8c1-c62a28f92b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2dc576c509042549f9583a9a7664d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:08Z,use_quota=True,user_id='acb9d45376cd421b80cc02c7300a34f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Creating volume 0980db8e-2438-44c3-a8c1-c62a28f92b49 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:03:09 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:09 devstack quobyte-client[83541]: System call of process 88738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:03:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=36, name=volume-0980db8e-2438-44c3-a8c1-c62a28f92b49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 1073741824" returned: 0 in 0.813s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49" returned: 0 in 0.188s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] <== create_volume: return (1105ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53daa944-fd69-4d13-9a03-e4cb715c392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0980db8e-2438-44c3-a8c1-c62a28f92b49', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807c189b-aab4-4ddd-af76-71ecb5208891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Volume volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 (0980db8e-2438-44c3-a8c1-c62a28f92b49): created successfully Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807c189b-aab4-4ddd-af76-71ecb5208891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Flow 'volume_create_manager' (5cc4ed1c-ed81-4c17-8301-a598f11945a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8ed3d351-c2a0-4515-af79-b8bff97dda6f tempest-VolumesListAdminTestJSON-1657328228 None] Created volume successfully. Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Acquiring lock "cinder-0980db8e-2438-44c3-a8c1-c62a28f92b49-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-e5da47b5-939a-4473-abb0-385675f588d6-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "cinder-0980db8e-2438-44c3-a8c1-c62a28f92b49-delete_volume" acquired by "delete_volume" :: waited 0.189s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-e5da47b5-939a-4473-abb0-385675f588d6-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-quobyte-e5da47b5-939a-4473-abb0-385675f588d6" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Acquiring lock "cinder-quobyte-0980db8e-2438-44c3-a8c1-c62a28f92b49" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-e5da47b5-939a-4473-abb0-385675f588d6" acquired by "delete_volume" :: waited 0.053s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "cinder-quobyte-0980db8e-2438-44c3-a8c1-c62a28f92b49" acquired by "delete_volume" :: waited 0.056s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab707e55-8a0f-4e11-be6e-246e290b61a9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5bce33-52bb-4317-a6e2-9e0eda266a81]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6" returned: 0 in 0.844s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:12 devstack quobyte-client[83541]: System call of process 88745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:03:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e5da47b5-939a-4473-abb0-385675f588d6" returned: 0 in 0.200s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-e5da47b5-939a-4473-abb0-385675f588d6" released by "delete_volume" :: held 1.276s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49" returned: 0 in 1.149s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0980db8e-2438-44c3-a8c1-c62a28f92b49" returned: 0 in 0.441s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "cinder-quobyte-0980db8e-2438-44c3-a8c1-c62a28f92b49" released by "delete_volume" :: held 2.100s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:13 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Created reservations ['b22491bf-ea14-4fa9-bc10-e92331fa9e8a', 'd180903b-d31a-4636-8408-c10397ba4882', 'f25037f8-d04d-44d7-9f91-8100c151d576', '65ea47ac-6e69-47fb-ab6d-dca4e4ce5cbd'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Created reservations ['c18815fa-be51-4b3a-a9f0-9b5a97406d16', 'fbe184ef-56b6-4ab9-85cd-364dab7c2784', '981050f2-6f53-488d-b358-2d948fdbc26c', '7db0b60e-28eb-4830-87bc-f7dac078c69d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.483s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:14 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Deleted volume successfully. Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-1d4b9efd-827b-4480-b55e-62acd5d40739-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.744s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-1d4b9efd-827b-4480-b55e-62acd5d40739-delete_volume" acquired by "delete_volume" :: waited 0.236s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-36755332-f451-43ff-8272-6d34afbc8711 tempest-VolumesListAdminTestJSON-1657328228 None] Lock "cinder-0980db8e-2438-44c3-a8c1-c62a28f92b49-delete_volume" released by "delete_volume" :: held 4.471s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:15 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Deleted volume successfully. Sep 16 13:03:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-quobyte-1d4b9efd-827b-4480-b55e-62acd5d40739" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-58461854-e215-4896-a741-5f71a6d0ddac tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-e5da47b5-939a-4473-abb0-385675f588d6-delete_volume" released by "delete_volume" :: held 4.587s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-1d4b9efd-827b-4480-b55e-62acd5d40739" acquired by "delete_volume" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:16 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe52fc-9a9b-4a94-88b7-223d9518e6c7]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739" returned: 0 in 1.101s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-1d4b9efd-827b-4480-b55e-62acd5d40739" returned: 0 in 0.259s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-1d4b9efd-827b-4480-b55e-62acd5d40739" released by "delete_volume" :: held 1.728s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Created reservations ['6bf7dcf1-cbe1-4933-b934-7752da4398a2', '60798651-729c-4558-be99-52530d4b1427', 'eb675967-d840-45e8-aa4e-01eb25a40ee9', '1c884b5f-a8f0-4442-b19b-4745a35054cb'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.222s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:19 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Deleted volume successfully. Sep 16 13:03:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-26d1f8d8-3960-4f54-95ae-9a257f66434b tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-1d4b9efd-827b-4480-b55e-62acd5d40739-delete_volume" released by "delete_volume" :: held 3.820s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-6a48b10f-423f-451e-b2d0-f882db77c42b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-6a48b10f-423f-451e-b2d0-f882db77c42b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "cinder-quobyte-6a48b10f-423f-451e-b2d0-f882db77c42b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-6a48b10f-423f-451e-b2d0-f882db77c42b" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59831a-69f2-4156-83af-c0e897adb499]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b" returned: 0 in 0.531s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a48b10f-423f-451e-b2d0-f882db77c42b" returned: 0 in 0.198s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-quobyte-6a48b10f-423f-451e-b2d0-f882db77c42b" released by "delete_volume" :: held 0.921s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:21 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Created reservations ['ea7cdab2-8d0b-4610-8f81-51272cdcded8', 'bfec236d-ffc6-4006-ad38-71b1289e4e11', '7b57e605-32b8-432f-8ec9-4dab88afd4f6', '3d6e2604-78fa-4b49-b451-ec359f377ed7'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Deleted volume successfully. Sep 16 13:03:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-69286119-836e-46e3-980a-a71ec03276f4 tempest-VolumesListAdminTestJSON-526157357 None] Lock "cinder-6a48b10f-423f-451e-b2d0-f882db77c42b-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:31 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=52,cinder:SELECT=20,cinder:DELETE=7,cinder:INSERT=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:03:32 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=39,cinder:INSERT=14,cinder:DELETE=2,cinder:UPDATE=45 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:03:33 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Flow 'volume_create_manager' (f057f730-44f6-4281-a84f-45395b974578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc9226e-9751-464a-871e-d41e57d881b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc9226e-9751-464a-871e-d41e57d881b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-174118931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7434cb87-0ae0-445d-8b6f-4accac5acd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4733c69cf5f4a86bedf686e8f7f7068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:33Z,use_quota=True,user_id='43bd8bfe07364a20bff7083a3c990bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a393c96-6896-433c-9cab-7ec0ad3c85f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a393c96-6896-433c-9cab-7ec0ad3c85f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62fd3cf-9b89-49ce-bc59-61d484d3d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62fd3cf-9b89-49ce-bc59-61d484d3d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7434cb87-0ae0-445d-8b6f-4accac5acd70', 'volume_name': 'volume-7434cb87-0ae0-445d-8b6f-4accac5acd70', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893daec6-dfff-4c30-9f00-40a087fc40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893daec6-dfff-4c30-9f00-40a087fc40fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf641ca-81a0-4161-a8ba-c5c45b636be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:33 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Volume 7434cb87-0ae0-445d-8b6f-4accac5acd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7434cb87-0ae0-445d-8b6f-4accac5acd70', 'volume_size': 1} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-174118931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7434cb87-0ae0-445d-8b6f-4accac5acd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4733c69cf5f4a86bedf686e8f7f7068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:33Z,use_quota=True,user_id='43bd8bfe07364a20bff7083a3c990bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Creating volume 7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:03:33 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:03:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:33 devstack quobyte-client[83541]: System call of process 88817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:03:33 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=37, name=volume-7434cb87-0ae0-445d-8b6f-4accac5acd70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 1073741824" returned: 0 in 0.577s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70" returned: 0 in 0.180s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] <== create_volume: return (865ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf641ca-81a0-4161-a8ba-c5c45b636be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7434cb87-0ae0-445d-8b6f-4accac5acd70', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a2a63-5729-40f5-b6f1-3fcb8f113d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Volume volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 (7434cb87-0ae0-445d-8b6f-4accac5acd70): created successfully Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a2a63-5729-40f5-b6f1-3fcb8f113d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Flow 'volume_create_manager' (f057f730-44f6-4281-a84f-45395b974578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-45c9df80-8086-42e1-967b-af0373fe78ec tempest-SnapshotMetadataTestJSON-1882355526 None] Created volume successfully. Sep 16 13:03:35 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.034s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Creating offline snapshot 9fa073b3-b923-4a63-a982-0089eae3f2fa of volume 7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:03:35 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[74abec7e-9cd8-4f27-83bc-fe22e3867860]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:36 devstack quobyte-client[83541]: System call of process 88823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:03:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70" returned: 0 in 0.946s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:37 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=38, name=volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa 1G" returned: 0 in 0.356s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:37 devstack quobyte-client[83541]: System call of process 88829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:03:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "qemu-img rebase -u -b volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.276s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:03:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.178s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.247s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.info" returned: 0 in 0.129s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.info" returned: 0 in 0.130s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-62f43467-883b-4186-8a33-78c3a8e8b879 tempest-SnapshotMetadataTestJSON-1882355526 None] Create snapshot completed successfully Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.226s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "cinder-9fa073b3-b923-4a63-a982-0089eae3f2fa-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-9fa073b3-b923-4a63-a982-0089eae3f2fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:41 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" acquired by "delete_snapshot" :: waited 0.076s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "cinder-quobyte-9fa073b3-b923-4a63-a982-0089eae3f2fa" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-9fa073b3-b923-4a63-a982-0089eae3f2fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Deleting offline snapshot 9fa073b3-b923-4a63-a982-0089eae3f2fa of volume 7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] snapshot_file for this snap is: volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d393ad-f23b-4b13-89e7-41736dfb9c2c]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.529s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7434cb87-0ae0-445d-8b6f-4accac5acd70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10da8cb-b74d-47dd-8c32-e1f04d06dce1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70" returned: 0 in 0.541s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.258s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70.9fa073b3-b923-4a63-a982-0089eae3f2fa" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-9fa073b3-b923-4a63-a982-0089eae3f2fa" released by "_delete_snapshot" :: held 1.720s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" released by "delete_snapshot" :: held 1.751s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:43 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Created reservations ['01bd59f1-bb5f-4b30-a425-eba6458ff0bc', '485cee66-5deb-45ab-a826-05e969d8df8c', '7ae50172-7ebb-4cc3-aa18-e82a0547296d', '7f9bcb7f-15c0-47a3-b982-d481a5206401'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Delete snapshot completed successfully. Sep 16 13:03:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ea0b6052-ce08-47e8-8b64-5bbfaebf7ce3 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-9fa073b3-b923-4a63-a982-0089eae3f2fa-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "cinder-7434cb87-0ae0-445d-8b6f-4accac5acd70-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-7434cb87-0ae0-445d-8b6f-4accac5acd70-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" acquired by "delete_volume" :: waited 0.034s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[42101bb3-4937-4a1b-a22b-42f334a0257b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70" returned: 0 in 0.510s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7434cb87-0ae0-445d-8b6f-4accac5acd70" returned: 0 in 0.110s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-quobyte-7434cb87-0ae0-445d-8b6f-4accac5acd70" released by "delete_volume" :: held 0.800s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:45 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Created reservations ['fcc3ae01-5199-45c3-a40b-540a5cd1ebc4', '461d9079-a893-4988-bf4c-f6db5ef3e8a5', '8345586e-35e5-4aee-9f03-74659ec41655', '7d28834f-edd3-4c01-8d1b-d0ab5f183901'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:03:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Deleted volume successfully. Sep 16 13:03:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-235a4d8b-20ba-46d1-9419-c3d15af5bbe6 tempest-SnapshotMetadataTestJSON-1882355526 None] Lock "cinder-7434cb87-0ae0-445d-8b6f-4accac5acd70-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:03:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Flow 'volume_create_manager' (76aece08-22fe-49ef-bbd8-2e0464fdc750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff730fa3-b193-419c-a774-18394515ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff730fa3-b193-419c-a774-18394515ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-417293602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07ae5a7-4bec-4f2b-abf2-9474c346da28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87abfe235e7540ada436cdc2d0405cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:52Z,use_quota=True,user_id='f8820d7fae8446f9ac334145b7a8a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b817dbdd-28ff-498a-91f0-267693e97e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b817dbdd-28ff-498a-91f0-267693e97e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a4e09e-374b-49db-914b-7816add72c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a4e09e-374b-49db-914b-7816add72c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b07ae5a7-4bec-4f2b-abf2-9474c346da28', 'volume_name': 'volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51dfcc7-7221-475f-bcfe-02f901ef9881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51dfcc7-7221-475f-bcfe-02f901ef9881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497db7cc-1054-46b2-b34a-27474aedde24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:03:52 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Volume b07ae5a7-4bec-4f2b-abf2-9474c346da28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 13:03:52 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Cloning b07ae5a7-4bec-4f2b-abf2-9474c346da28 from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:03:53 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:03:53 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Image download 20.69 MB at 20.69 MB/s Sep 16 13:03:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[54630f7e-eaa3-49a6-b95b-a0f86db3481d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:53 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD Sep 16 13:03:54 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:03:55 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Sep 16 13:03:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD" returned: 0 in 2.194s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:55 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 is fetched for user f8820d7fae8446f9ac334145b7a8a625. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:03:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b832d-bebf-45ff-a83d-8d9b68092412]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:56 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD Sep 16 13:03:56 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:03:58 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD" returned: 0 in 2.465s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-417293602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07ae5a7-4bec-4f2b-abf2-9474c346da28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87abfe235e7540ada436cdc2d0405cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:03:52Z,use_quota=True,user_id='f8820d7fae8446f9ac334145b7a8a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Creating volume b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:03:58 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:03:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:59 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=40, name=volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 1073741824" returned: 0 in 0.477s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Attempting download of 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume b07ae5a7-4bec-4f2b-abf2-9474c346da28. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed92010c-d551-439f-8ac1-e2155c3de0ed]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:03:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_2r00hno3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_2r00hno3" returned: 0 in 0.532s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_2r00hno3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_2r00hno3" returned: 1 in 2.266s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_2r00hno3' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:04:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962f412-a656-47dd-a279-9e4d27792171]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD" returned: 0 in 1.202s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:04 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 was qcow2, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:04:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:04 devstack quobyte-client[83541]: System call of process 88965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:04 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=40, name=volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:04:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 2.162s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:06 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_cpwcc_0adevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:04:06 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Converted 112.00 MB image at 51.04 MB/s Sep 16 13:04:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 1G" returned: 0 in 0.309s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[044198b6-cea3-4a39-a141-75980c3d7b90]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 0.915s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 1 in 0.570s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Downloaded image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume b07ae5a7-4bec-4f2b-abf2-9474c346da28 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 for user f8820d7fae8446f9ac334145b7a8a625 is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Marking volume b07ae5a7-4bec-4f2b-abf2-9474c346da28 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Copying metadata from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 to b07ae5a7-4bec-4f2b-abf2-9474c346da28. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Creating volume glance metadata for volume b07ae5a7-4bec-4f2b-abf2-9474c346da28 backed by image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497db7cc-1054-46b2-b34a-27474aedde24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da60f6e3-90c0-4990-b2f0-1fb93ae31bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Volume volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 (b07ae5a7-4bec-4f2b-abf2-9474c346da28): created successfully Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da60f6e3-90c0-4990-b2f0-1fb93ae31bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Flow 'volume_create_manager' (76aece08-22fe-49ef-bbd8-2e0464fdc750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:04:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-21f4bda6-2303-4bd7-b9f0-0cb5cc1afde0 tempest-VolumesExtendTest-1932466605 None] Created volume successfully. Sep 16 13:04:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4338f51-dfde-4cdc-84a7-bf37b57475c9]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 0.950s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:13 devstack quobyte-client[83541]: System call of process 89002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 1 in 1.279s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:04:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 2G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:14 devstack quobyte-client[83541]: System call of process 89007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 2G" returned: 0 in 0.351s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.144s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:14 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-213043ad-a585-4ef7-b387-bd9da63032b3 tempest-VolumesExtendTest-1932466605 None] Extend volume completed successfully. Sep 16 13:04:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-b07ae5a7-4bec-4f2b-abf2-9474c346da28-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "cinder-b07ae5a7-4bec-4f2b-abf2-9474c346da28-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:16 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-quobyte-b07ae5a7-4bec-4f2b-abf2-9474c346da28" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-b07ae5a7-4bec-4f2b-abf2-9474c346da28" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa6a73-1b63-48b0-87d2-928c4c6066b7]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 0.628s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:18 devstack quobyte-client[83541]: System call of process 89018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 1 in 1.291s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:04:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b07ae5a7-4bec-4f2b-abf2-9474c346da28" returned: 0 in 0.330s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-b07ae5a7-4bec-4f2b-abf2-9474c346da28" released by "delete_volume" :: held 2.982s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:19 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Created reservations ['99700ed0-03e1-4642-93a6-7866b82b08f7', '133673d5-d9e0-4223-9fdc-a8a86caf7ffa', 'a8725c87-21af-4c54-abdd-b8a83ade7ab8', '2e90b9a4-21ce-4bbb-b9db-5f2f84e191ec'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.410s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:20 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:04:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Deleted volume successfully. Sep 16 13:04:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d24e9bd7-bbc1-4584-857f-16192e82661b tempest-VolumesExtendTest-1932466605 None] Lock "cinder-b07ae5a7-4bec-4f2b-abf2-9474c346da28-delete_volume" released by "delete_volume" :: held 5.651s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Flow 'volume_create_manager' (7f438ee6-acc4-4107-ba8f-38d56396470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7589109-82ae-407a-bc24-9be32200f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7589109-82ae-407a-bc24-9be32200f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129813087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cbebc9-01ac-4d86-8b66-803542d35ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87abfe235e7540ada436cdc2d0405cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:04:23Z,use_quota=True,user_id='f8820d7fae8446f9ac334145b7a8a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ada8b6-3769-476a-9395-63e292392153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ada8b6-3769-476a-9395-63e292392153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13d810b-e54d-407c-86da-06eff9bc9177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13d810b-e54d-407c-86da-06eff9bc9177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1cbebc9-01ac-4d86-8b66-803542d35ac6', 'volume_name': 'volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e3888-738f-4b81-aa9e-62b279076f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e3888-738f-4b81-aa9e-62b279076f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46ead8-67ea-48c8-9e57-f3006a486915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:26 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Volume f1cbebc9-01ac-4d86-8b66-803542d35ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6', 'volume_size': 1} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129813087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cbebc9-01ac-4d86-8b66-803542d35ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87abfe235e7540ada436cdc2d0405cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:04:23Z,use_quota=True,user_id='f8820d7fae8446f9ac334145b7a8a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Creating volume f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.160s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:04:26 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:04:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:27 devstack quobyte-client[83541]: System call of process 89206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:27 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=41, name=volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:04:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 1073741824" returned: 0 in 1.696s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 2.039s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] <== create_volume: return (5009ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:04:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.316s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:32 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=10 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:04:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46ead8-67ea-48c8-9e57-f3006a486915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada9395-9368-4de7-95fd-a62915fc06f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:04:32 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=35,cinder:SELECT=33,cinder:DELETE=1,cinder:INSERT=15 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:04:33 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Volume volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 (f1cbebc9-01ac-4d86-8b66-803542d35ac6): created successfully Sep 16 13:04:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada9395-9368-4de7-95fd-a62915fc06f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:04:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Flow 'volume_create_manager' (7f438ee6-acc4-4107-ba8f-38d56396470d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:04:33 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0289858e-195f-4d2e-8eec-89fe7546dbcf tempest-VolumesExtendTest-1932466605 None] Created volume successfully. Sep 16 13:04:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Creating offline snapshot 356006be-0a15-4c38-afc2-ad1697b75e9d of volume f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:04:35 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8811ac0-a520-4fae-bdcb-7436a3fe936b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:37 devstack quobyte-client[83541]: System call of process 89397 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 2.216s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:38 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=42, name=volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:04:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d 1G" returned: 0 in 1.013s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img rebase -u -b volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 0.325s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 0.535s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:04:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 0.279s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.175s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.info" returned: 0 in 0.907s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:04:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.801s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:04:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.info" returned: 0 in 0.855s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.362s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f81fc9ce-43e6-4c1e-bc3e-1922273c6881 tempest-VolumesExtendTest-1932466605 None] Create snapshot completed successfully Sep 16 13:04:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:43 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8f303-aa59-4e2f-b480-ffef9f97a518]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 0.959s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d 2G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:45 devstack quobyte-client[83541]: System call of process 89532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d 2G" returned: 0 in 0.480s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.739s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5dd79449-0bd4-445d-b0c5-95655404ad6a tempest-VolumesExtendTest-1932466605 None] Extend volume completed successfully. Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-356006be-0a15-4c38-afc2-ad1697b75e9d-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-356006be-0a15-4c38-afc2-ad1697b75e9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-quobyte-356006be-0a15-4c38-afc2-ad1697b75e9d" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-356006be-0a15-4c38-afc2-ad1697b75e9d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Deleting offline snapshot 356006be-0a15-4c38-afc2-ad1697b75e9d of volume f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] snapshot_file for this snap is: volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab101446-34d5-493b-a984-eccb15f41886]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:47 devstack quobyte-client[83541]: System call of process 89566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 1.139s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:04:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7616e-213b-4704-a02b-0cf74014c4fb]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:49 devstack quobyte-client[83541]: System call of process 89579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 2.012s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:51 devstack quobyte-client[83541]: System call of process 89609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 1.606s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6.356006be-0a15-4c38-afc2-ad1697b75e9d" returned: 0 in 0.389s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-356006be-0a15-4c38-afc2-ad1697b75e9d" released by "_delete_snapshot" :: held 6.827s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" released by "delete_snapshot" :: held 6.924s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:54 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Created reservations ['858c6273-78d6-42c9-9a6c-0c0b3d261e3e', '09ddce8f-a8fa-490b-9b3b-eb3f42e5b4e4', '003c82cc-5755-47a4-86a1-226d8d57321f', 'c553254c-347b-4e5c-b85b-870184e71d86'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:04:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Delete snapshot completed successfully. Sep 16 13:04:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cacb1b5-b3bf-4ee5-8341-4ac96b298fa7 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-356006be-0a15-4c38-afc2-ad1697b75e9d-delete_snapshot" released by "delete_snapshot" :: held 8.197s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-f1cbebc9-01ac-4d86-8b66-803542d35ac6-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-f1cbebc9-01ac-4d86-8b66-803542d35ac6-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" acquired by "delete_volume" :: waited 0.062s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4efeb9-fee6-47eb-bab0-5b8ac3f99f79]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:04:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:58 devstack quobyte-client[83541]: System call of process 89632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:04:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 1.209s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f1cbebc9-01ac-4d86-8b66-803542d35ac6" returned: 0 in 0.256s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-quobyte-f1cbebc9-01ac-4d86-8b66-803542d35ac6" released by "delete_volume" :: held 1.924s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Created reservations ['ddae96a1-8adb-4d6c-9ed3-1afb8151a672', '7da4d656-2944-4649-aa4a-bb51754cc4de', 'e727820c-2431-495c-9693-28689bf39e02', 'e39348ba-1e4d-4795-b565-29ced1285230'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.114s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:04:59 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:04:59 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Deleted volume successfully. Sep 16 13:05:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e6b15f29-5822-4bbc-ae7b-d3663c3a64d9 tempest-VolumesExtendTest-1932466605 None] Lock "cinder-f1cbebc9-01ac-4d86-8b66-803542d35ac6-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-631ac219-50ed-48b2-a270-29cae51b60bc tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-631ac219-50ed-48b2-a270-29cae51b60bc tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-631ac219-50ed-48b2-a270-29cae51b60bc tempest-TaggedBootDevicesTest-1991235254 None] Terminate volume connection completed successfully. Sep 16 13:05:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-631ac219-50ed-48b2-a270-29cae51b60bc tempest-TaggedBootDevicesTest-1991235254 None] Deleting attachment fe294cc1-35a6-4527-8f99-161684f37fbd. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:05:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-ecd3389f-2198-4130-b2c4-346535ae7a0f tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-ecd3389f-2198-4130-b2c4-346535ae7a0f tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-ecd3389f-2198-4130-b2c4-346535ae7a0f tempest-TaggedBootDevicesTest-1991235254 None] Terminate volume connection completed successfully. Sep 16 13:05:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-ecd3389f-2198-4130-b2c4-346535ae7a0f tempest-TaggedBootDevicesTest-1991235254 None] Deleting attachment 14660766-d6a8-4499-b7c9-8c297e8cccb8. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:05:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-7ce0bc1e-6fbc-426b-b8d6-e9e5f9ff562e tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-7ce0bc1e-6fbc-426b-b8d6-e9e5f9ff562e tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-7ce0bc1e-6fbc-426b-b8d6-e9e5f9ff562e tempest-TaggedBootDevicesTest-1991235254 None] Terminate volume connection completed successfully. Sep 16 13:05:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-f004b88e-80ca-417a-b433-1c7d5a098537 req-7ce0bc1e-6fbc-426b-b8d6-e9e5f9ff562e tempest-TaggedBootDevicesTest-1991235254 None] Deleting attachment a832f5d3-9d4e-4b21-a9a9-16a3feb1352a. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:05:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:10 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Flow 'volume_create_manager' (a1a113a6-50c9-4496-a7ff-b98fa2c109a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf6b864-b091-4a47-b86b-9129479fe806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf6b864-b091-4a47-b86b-9129479fe806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-331497005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5337e44-e5a2-41ab-9683-73d7a73fe41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb995e09194f93ad28a15732c32ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:05:11Z,use_quota=True,user_id='4318e87458494a00bded8f174cf64b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f835ad9-b1c4-4c6d-9441-d2c98451bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f835ad9-b1c4-4c6d-9441-d2c98451bd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dde3a-bb44-487b-90dd-7cd791acc78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dde3a-bb44-487b-90dd-7cd791acc78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5337e44-e5a2-41ab-9683-73d7a73fe41b', 'volume_name': 'volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89de6c03-946d-4dfc-bb62-949a9c96cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89de6c03-946d-4dfc-bb62-949a9c96cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70218ec-a6d3-4778-a2d9-6ea12cacdada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:11 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Volume d5337e44-e5a2-41ab-9683-73d7a73fe41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b', 'volume_size': 1} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-331497005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5337e44-e5a2-41ab-9683-73d7a73fe41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb995e09194f93ad28a15732c32ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:05:11Z,use_quota=True,user_id='4318e87458494a00bded8f174cf64b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Creating volume d5337e44-e5a2-41ab-9683-73d7a73fe41b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:05:11 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:11 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=44, name=volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b 1073741824" returned: 0 in 0.601s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b" returned: 0 in 0.169s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] <== create_volume: return (915ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70218ec-a6d3-4778-a2d9-6ea12cacdada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e033d0c4-c53d-4109-a461-a53e92b26c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:12 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Volume volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b (d5337e44-e5a2-41ab-9683-73d7a73fe41b): created successfully Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e033d0c4-c53d-4109-a461-a53e92b26c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Flow 'volume_create_manager' (a1a113a6-50c9-4496-a7ff-b98fa2c109a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:05:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ccc54f4f-5720-452f-ae74-e7dc2e46e92c tempest-ServersNegativeTestJSON-1315624980 None] Created volume successfully. Sep 16 13:05:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-3d715ae6-8dae-4369-88d5-1a756017b888-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-3d715ae6-8dae-4369-88d5-1a756017b888-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:14 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-quobyte-3d715ae6-8dae-4369-88d5-1a756017b888" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-3d715ae6-8dae-4369-88d5-1a756017b888" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:14 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b06aa0d-bab8-4dcd-b5c9-ad787ab42705]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:05:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888" returned: 0 in 1.315s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3d715ae6-8dae-4369-88d5-1a756017b888" returned: 0 in 0.238s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-3d715ae6-8dae-4369-88d5-1a756017b888" released by "delete_volume" :: held 2.035s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:17 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Created reservations ['5d0641c8-e19a-402a-afde-2173295f116a', 'b50a214b-ec06-41de-8d8e-557c0f359607', '6d32c920-d2c4-4e7e-8fb5-a2fae0f2cf77', '375ab6ac-0148-4c74-8527-ac8c2227122a'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:05:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:17 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:05:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Flow 'volume_create_manager' (efb8d634-de6b-494c-9181-ddff000a9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:05:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382dfce-7956-4a7b-94e5-ccae04c0d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4382dfce-7956-4a7b-94e5-ccae04c0d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1661058178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a1023-cfc2-439e-8bb3-e52cd9d04705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb995e09194f93ad28a15732c32ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:05:17Z,use_quota=True,user_id='4318e87458494a00bded8f174cf64b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18e40d1-4294-48e7-abc4-2ec1c8a0b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18e40d1-4294-48e7-abc4-2ec1c8a0b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4963fc29-b6a5-4594-b09d-05eb611fcfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4963fc29-b6a5-4594-b09d-05eb611fcfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398a1023-cfc2-439e-8bb3-e52cd9d04705', 'volume_name': 'volume-398a1023-cfc2-439e-8bb3-e52cd9d04705', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb90f4-ab62-4a55-aa51-0ec44867a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bb90f4-ab62-4a55-aa51-0ec44867a531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7561c5a2-c350-411a-9f02-fb8c09df8c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Volume 398a1023-cfc2-439e-8bb3-e52cd9d04705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398a1023-cfc2-439e-8bb3-e52cd9d04705', 'volume_size': 1} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1661058178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a1023-cfc2-439e-8bb3-e52cd9d04705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2efb995e09194f93ad28a15732c32ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:05:17Z,use_quota=True,user_id='4318e87458494a00bded8f174cf64b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Creating volume 398a1023-cfc2-439e-8bb3-e52cd9d04705 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:05:18 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:05:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:18 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=45, name=volume-398a1023-cfc2-439e-8bb3-e52cd9d04705, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-5c8e52ff-55d1-409a-9b2b-ba7646c185cf-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 1073741824" returned: 0 in 2.367s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-5c8e52ff-55d1-409a-9b2b-ba7646c185cf-delete_volume" acquired by "delete_volume" :: waited 1.358s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.532s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Deleted volume successfully. Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705" returned: 0 in 0.680s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] <== create_volume: return (3182ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.200s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7561c5a2-c350-411a-9f02-fb8c09df8c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398a1023-cfc2-439e-8bb3-e52cd9d04705', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be55883-babf-40d4-aeab-f27522161ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3476191f-55c6-4053-be33-1c0f5e6a555c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-3d715ae6-8dae-4369-88d5-1a756017b888-delete_volume" released by "delete_volume" :: held 7.548s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:21 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Volume volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 (398a1023-cfc2-439e-8bb3-e52cd9d04705): created successfully Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be55883-babf-40d4-aeab-f27522161ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Flow 'volume_create_manager' (efb8d634-de6b-494c-9181-ddff000a9c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:05:21 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-quobyte-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-27fc9747-aa8e-4f11-883f-a315e2ebb7fa tempest-ServersNegativeTestJSON-1315624980 None] Created volume successfully. Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" acquired by "delete_volume" :: waited 0.027s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b48e04e-bb59-44bd-a407-318b836c3cd8]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:05:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:22 devstack quobyte-client[83541]: System call of process 89717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:05:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" returned: 0 in 0.584s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" returned: 0 in 0.169s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-5c8e52ff-55d1-409a-9b2b-ba7646c185cf" released by "delete_volume" :: held 1.318s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "cinder-398a1023-cfc2-439e-8bb3-e52cd9d04705-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-398a1023-cfc2-439e-8bb3-e52cd9d04705-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Created reservations ['2a3abbf8-f6c2-467d-bbb8-0d4b33b386bc', '5cd09f2a-934f-4905-8ea3-85e7147ce1aa', 'ec3a59f1-b14c-46de-b034-a804eeafddcf', '69fb8682-d88d-4da6-8341-3011350a1637'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:05:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "cinder-quobyte-398a1023-cfc2-439e-8bb3-e52cd9d04705" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-quobyte-398a1023-cfc2-439e-8bb3-e52cd9d04705" acquired by "delete_volume" :: waited 0.058s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4775d-c3c9-4336-ba21-7b78e373bbff]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:05:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.042s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.201s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:25 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Deleted volume successfully. Sep 16 13:05:26 devstack quobyte-client[83541]: System call of process 89737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705" returned: 0 in 1.216s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f84ad88b-8f86-4d05-b8f0-6133fd36d971 tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-5c8e52ff-55d1-409a-9b2b-ba7646c185cf-delete_volume" released by "delete_volume" :: held 5.288s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-398a1023-cfc2-439e-8bb3-e52cd9d04705" returned: 0 in 0.361s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-quobyte-398a1023-cfc2-439e-8bb3-e52cd9d04705" released by "delete_volume" :: held 1.937s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:26 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "cinder-quobyte-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" acquired by "delete_volume" :: waited 0.031s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[804252fd-8605-4078-a5da-532d74e12219]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:05:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:27 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Created reservations ['240dc949-c970-41d1-aa5d-52f9ad477d10', '4e10abdd-09fc-4639-8b9d-e0309e0d71a5', '89d27853-1415-493a-9bfe-5b89d0840ca3', '471536a5-5875-46cc-a0ba-09b855392a95'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:05:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 0.745s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "cinder-d5337e44-e5a2-41ab-9683-73d7a73fe41b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 1 in 0.711s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-d5337e44-e5a2-41ab-9683-73d7a73fe41b-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" returned: 0 in 0.403s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-quobyte-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1" released by "delete_volume" :: held 2.361s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.353s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:29 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Deleted volume successfully. Sep 16 13:05:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "cinder-quobyte-d5337e44-e5a2-41ab-9683-73d7a73fe41b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-quobyte-d5337e44-e5a2-41ab-9683-73d7a73fe41b" acquired by "delete_volume" :: waited 0.038s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1552989-b12e-4821-93af-a9a1de38ba7e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d69d2f6b-e750-4d1d-a266-15db3278f239 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-398a1023-cfc2-439e-8bb3-e52cd9d04705-delete_volume" released by "delete_volume" :: held 5.373s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Created reservations ['c63f0adc-3d05-4757-95d3-4a2b1f04cf4a', '64d1f9eb-0e7a-42a1-9598-bd2dec926bc6', '8f34187a-6db6-40ff-964d-56cbd93599bf', 'd33f8ac4-7038-4b4a-8475-bb2d92410eb0'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b" returned: 0 in 0.611s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d5337e44-e5a2-41ab-9683-73d7a73fe41b" returned: 0 in 0.192s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-quobyte-d5337e44-e5a2-41ab-9683-73d7a73fe41b" released by "delete_volume" :: held 0.978s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.137s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Deleted volume successfully. Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Created reservations ['d20c2f72-5d3c-4c6d-8475-2b1a41721211', '12ed5324-352a-43f3-9647-ec1e17a5636e', 'c1cef146-1b64-4c92-bf8d-531594b48dab', 'bbb66832-f397-437c-be22-fce4940d3ec2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ff494ac-7840-4b0b-aae7-28b241ed188c tempest-TaggedBootDevicesTest-1991235254 None] Lock "cinder-2fd8dd1b-5a02-4d6d-b182-eca954aaefc1-delete_volume" released by "delete_volume" :: held 6.484s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.161s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:32 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Deleted volume successfully. Sep 16 13:05:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1719c9d3-7c34-4403-b296-5205e790a428 tempest-ServersNegativeTestJSON-1315624980 None] Lock "cinder-d5337e44-e5a2-41ab-9683-73d7a73fe41b-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:05:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:05:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.335s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:05:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:05:42 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=80,cinder:DELETE=4,cinder:SELECT=49,cinder:INSERT=15 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:05:43 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=37,cinder:DELETE=6,cinder:UPDATE=44,cinder:INSERT=13 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.308s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:06:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:07:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:07:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:07:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:07:53 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Flow 'volume_create_manager' (16e6dcb8-d495-47d3-9686-1a233a2e60d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2541328-e140-43a7-937d-fd74a1e803d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2541328-e140-43a7-937d-fd74a1e803d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2134020268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd7918-0212-42f4-b826-d422558a13ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5314d2ce5ddb447bb2f0b3f3ed3bd3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:07:53Z,use_quota=True,user_id='a33eb2eff7f44589bc6903d850d364eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3343715-4269-40d3-8db2-92e49266b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3343715-4269-40d3-8db2-92e49266b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665634f-2be1-4039-9822-4dde5b113939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665634f-2be1-4039-9822-4dde5b113939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdd7918-0212-42f4-b826-d422558a13ac', 'volume_name': 'volume-cbdd7918-0212-42f4-b826-d422558a13ac', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132c5b97-5a8b-44e7-87e6-e3eaf4674c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132c5b97-5a8b-44e7-87e6-e3eaf4674c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea310ee-7dc7-4462-90ea-6b28f6f4c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:53 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume cbdd7918-0212-42f4-b826-d422558a13ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdd7918-0212-42f4-b826-d422558a13ac', 'volume_size': 1} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2134020268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd7918-0212-42f4-b826-d422558a13ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5314d2ce5ddb447bb2f0b3f3ed3bd3e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:07:53Z,use_quota=True,user_id='a33eb2eff7f44589bc6903d850d364eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Creating volume cbdd7918-0212-42f4-b826-d422558a13ac {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:07:53 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:07:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:07:53 devstack quobyte-client[83541]: System call of process 90410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:07:53 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=46, name=volume-cbdd7918-0212-42f4-b826-d422558a13ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac 1073741824" returned: 0 in 0.462s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] <== create_volume: return (693ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea310ee-7dc7-4462-90ea-6b28f6f4c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdd7918-0212-42f4-b826-d422558a13ac', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a588e0f-92d5-430e-a95f-075a0c605221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:07:54 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume volume-cbdd7918-0212-42f4-b826-d422558a13ac (cbdd7918-0212-42f4-b826-d422558a13ac): created successfully Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a588e0f-92d5-430e-a95f-075a0c605221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:07:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Flow 'volume_create_manager' (16e6dcb8-d495-47d3-9686-1a233a2e60d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:07:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-60260afc-1d06-4acd-964e-77ece60218a7 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Created volume successfully. Sep 16 13:07:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:07:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:07:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27074d-cf86-433f-9eae-1d06f68bfe07]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:07:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac" returned: 0 in 0.695s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-cbdd7918-0212-42f4-b826-d422558a13ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8496e519-976e-49fc-9fdb-4407ec9ba078', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:08:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-c6996044-211c-4a4a-8e00-b6ea4d409699 req-79f78372-1587-4574-a5c2-3a30940a8c63 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] attachment_update completed successfully. Sep 16 13:08:10 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:08:10 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:08:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Flow 'volume_create_manager' (9e2f0594-1df8-4762-b8a0-5bf5e7115cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51449837-5082-4755-9961-b5ba116b0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51449837-5082-4755-9961-b5ba116b0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2064360856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202bc23d-f53f-4854-9f27-ae1bdef18434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eecdf5abcb463f83cf132de0fccc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:08:15Z,use_quota=True,user_id='0e0dd28d054f45adad0df02890ca25db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464843a3-1be2-45c6-9242-8c8cf85899e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464843a3-1be2-45c6-9242-8c8cf85899e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505356d0-6db1-487e-8a60-6cb0791ffd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505356d0-6db1-487e-8a60-6cb0791ffd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202bc23d-f53f-4854-9f27-ae1bdef18434', 'volume_name': 'volume-202bc23d-f53f-4854-9f27-ae1bdef18434', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f38d80-5c83-4ad4-a3d1-dc3f39635798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f38d80-5c83-4ad4-a3d1-dc3f39635798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adda6822-d068-4e7f-9d06-3bbbbe181ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:15 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume 202bc23d-f53f-4854-9f27-ae1bdef18434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202bc23d-f53f-4854-9f27-ae1bdef18434', 'volume_size': 1} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2064360856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202bc23d-f53f-4854-9f27-ae1bdef18434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eecdf5abcb463f83cf132de0fccc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:08:15Z,use_quota=True,user_id='0e0dd28d054f45adad0df02890ca25db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Creating volume 202bc23d-f53f-4854-9f27-ae1bdef18434 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:08:15 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:08:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:16 devstack quobyte-client[83541]: System call of process 90879 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:08:16 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=47, name=volume-202bc23d-f53f-4854-9f27-ae1bdef18434, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:08:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 1073741824" returned: 0 in 0.695s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434" returned: 0 in 0.473s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] <== create_volume: return (1274ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (832baa8c-6b78-4435-8bc7-f8cc81982f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8f5a3b-56cc-466c-8a6a-c264aa14bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8f5a3b-56cc-466c-8a6a-c264aa14bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-269056474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c819178b-4539-4211-85e8-4204a52c399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:08:17Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4040be46-112d-4343-9954-19579dae679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4040be46-112d-4343-9954-19579dae679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1fe103-53e7-494e-aa4a-b325a77da8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1fe103-53e7-494e-aa4a-b325a77da8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c819178b-4539-4211-85e8-4204a52c399a', 'volume_name': 'volume-c819178b-4539-4211-85e8-4204a52c399a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399e84a-38bf-4267-8b45-a0fe88491993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d399e84a-38bf-4267-8b45-a0fe88491993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377340e7-569c-458d-8f9d-2d8ef2b18bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:17 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Volume c819178b-4539-4211-85e8-4204a52c399a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c819178b-4539-4211-85e8-4204a52c399a', 'volume_size': 1} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-269056474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c819178b-4539-4211-85e8-4204a52c399a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:08:17Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Creating volume c819178b-4539-4211-85e8-4204a52c399a {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:08:17 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:08:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:17 devstack quobyte-client[83541]: System call of process 90883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:08:17 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=48, name=volume-c819178b-4539-4211-85e8-4204a52c399a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adda6822-d068-4e7f-9d06-3bbbbe181ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202bc23d-f53f-4854-9f27-ae1bdef18434', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186303a-defc-4a2e-9b12-9be13ba99064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a 1073741824" returned: 0 in 0.756s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume volume-202bc23d-f53f-4854-9f27-ae1bdef18434 (202bc23d-f53f-4854-9f27-ae1bdef18434): created successfully Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186303a-defc-4a2e-9b12-9be13ba99064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Flow 'volume_create_manager' (9e2f0594-1df8-4762-b8a0-5bf5e7115cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a" returned: 0 in 0.578s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] <== create_volume: return (1355ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:08:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:18 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-446559ce-570d-4e79-92ed-8e624af261aa tempest-AttachVolumeShelveTestJSON-681045340 None] Created volume successfully. Sep 16 13:08:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377340e7-569c-458d-8f9d-2d8ef2b18bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c819178b-4539-4211-85e8-4204a52c399a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a3c49e-f082-4f3f-ba27-6797f7530b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:08:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Volume volume-c819178b-4539-4211-85e8-4204a52c399a (c819178b-4539-4211-85e8-4204a52c399a): created successfully Sep 16 13:08:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a3c49e-f082-4f3f-ba27-6797f7530b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:08:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (832baa8c-6b78-4435-8bc7-f8cc81982f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:08:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-08165845-3e3a-4ba8-ad6e-ad80864e853a tempest-AttachVolumeTestJSON-1305521161 None] Created volume successfully. Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09c8bdd-fb30-4e2d-b1c5-95795fb7c94d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a" returned: 0 in 0.502s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.571s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-c819178b-4539-4211-85e8-4204a52c399a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c210771-7999-4b64-bdbe-342be8a1590d', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:08:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:27 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-46a595bc-b6df-40e7-bfea-34cfdea5280e req-e129b00c-3157-4535-bb46-60abc2cba2c2 tempest-AttachVolumeTestJSON-1305521161 None] attachment_update completed successfully. Sep 16 13:08:31 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-df75b20b-2c2f-484a-a7a9-670318a536db req-288b05bb-7c8c-44f4-a85c-f543342e6177 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:31 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-df75b20b-2c2f-484a-a7a9-670318a536db req-288b05bb-7c8c-44f4-a85c-f543342e6177 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-df75b20b-2c2f-484a-a7a9-670318a536db req-288b05bb-7c8c-44f4-a85c-f543342e6177 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Terminate volume connection completed successfully. Sep 16 13:08:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-df75b20b-2c2f-484a-a7a9-670318a536db req-288b05bb-7c8c-44f4-a85c-f543342e6177 tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Deleting attachment 8496e519-976e-49fc-9fdb-4407ec9ba078. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "cinder-cbdd7918-0212-42f4-b826-d422558a13ac-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "cinder-cbdd7918-0212-42f4-b826-d422558a13ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:08:33 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "cinder-quobyte-cbdd7918-0212-42f4-b826-d422558a13ac" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "cinder-quobyte-cbdd7918-0212-42f4-b826-d422558a13ac" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c540022-bdfe-476e-af57-9456ec5843c0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac" returned: 0 in 0.469s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbdd7918-0212-42f4-b826-d422558a13ac" returned: 0 in 0.396s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "cinder-quobyte-cbdd7918-0212-42f4-b826-d422558a13ac" released by "delete_volume" :: held 1.364s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:08:35 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Created reservations ['5617f35d-3e60-439e-9604-bd31c62e8fa7', 'fbddce02-0a03-43f5-9693-e878f90eb566', '0519fd7d-a2b4-408a-9b41-d709472cb9fb', 'a3fd14f9-b9c9-48bd-9b48-6f98fd619c6b'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.236s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:08:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Deleted volume successfully. Sep 16 13:08:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35e2ce3-e9fa-4438-a557-7a865976f2bc tempest-TestServerVolumeAttachScenarioOldVersion-1936754133 None] Lock "cinder-cbdd7918-0212-42f4-b826-d422558a13ac-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.130s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:08:46 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=20,cinder:SELECT=13,cinder:DELETE=1,cinder:INSERT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:08:46 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=14,cinder:DELETE=2,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c8ab81-bae0-4b1e-bfaf-a4c2a12d2b22]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:08:51 devstack quobyte-client[83541]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434" returned: 0 in 0.564s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:08:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.629s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:08:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-202bc23d-f53f-4854-9f27-ae1bdef18434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a55bf7d-5d43-4320-ab02-61ebf944011d', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:08:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:08:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-91d10344-81de-4b11-b90e-38f45915d455 req-082895a0-0894-4a14-8756-d5f9e620ce9e tempest-AttachVolumeShelveTestJSON-681045340 None] attachment_update completed successfully. Sep 16 13:09:02 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:09:02 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:09:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.081s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:09:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:09:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.447s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:09:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:10:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Flow 'volume_create_manager' (9b462193-0957-4bff-b2a6-a294164e553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd38308e-dc4b-4a0f-a0a7-78438d1120ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd38308e-dc4b-4a0f-a0a7-78438d1120ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1665174291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf808182-59a6-4c47-a516-65b642056b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d9d52404f046d1840cc0d6b72fe6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:10:06Z,use_quota=True,user_id='273ec08e06a045eb8e561353821e694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e098685-3d22-42eb-a9fa-ca10915c8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e098685-3d22-42eb-a9fa-ca10915c8dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a664f9-1dd5-4a36-a2fe-927187e0c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:06 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:10:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a664f9-1dd5-4a36-a2fe-927187e0c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf808182-59a6-4c47-a516-65b642056b33', 'volume_name': 'volume-cf808182-59a6-4c47-a516-65b642056b33', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d704dd64-2308-45db-8cac-c8a6edfb1526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d704dd64-2308-45db-8cac-c8a6edfb1526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe34251-7ab9-4d55-a10b-057f3dec3b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Volume cf808182-59a6-4c47-a516-65b642056b33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf808182-59a6-4c47-a516-65b642056b33', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 13:10:07 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Cloning cf808182-59a6-4c47-a516-65b642056b33 from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:10:08 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:10:08 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Image download 20.69 MB at 20.69 MB/s Sep 16 13:10:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19a22a-c851-4d9b-b33f-3780738fe907]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:08 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD Sep 16 13:10:08 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:10:10 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Sep 16 13:10:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD" returned: 0 in 2.456s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:10 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 is fetched for user 273ec08e06a045eb8e561353821e694d. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:10:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a408b2-27e5-47e7-a5b7-57c1e6e67c0a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:11 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD Sep 16 13:10:11 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:10:13 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD" returned: 0 in 2.030s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1665174291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf808182-59a6-4c47-a516-65b642056b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d9d52404f046d1840cc0d6b72fe6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:10:06Z,use_quota=True,user_id='273ec08e06a045eb8e561353821e694d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Creating volume cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:10:13 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:13 devstack quobyte-client[83541]: System call of process 91906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:10:13 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=49, name=volume-cf808182-59a6-4c47-a516-65b642056b33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 1073741824" returned: 0 in 0.336s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:10:13 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Attempting download of 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume cf808182-59a6-4c47-a516-65b642056b33. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:10:14 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a378ff37-bf85-40bf-bb0b-417365404072]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_iytrncu5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_iytrncu5" returned: 0 in 0.443s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_iytrncu5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_iytrncu5" returned: 1 in 0.414s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_iytrncu5' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce16b3a-9e12-43c3-9f93-9bb32f7a871c]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 was qcow2, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:10:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:15 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=49, name=volume-cf808182-59a6-4c47-a516-65b642056b33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:10:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 1.185s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:16 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_w5en415zdevstack@QuobyteHD, size 112.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:10:16 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Converted 112.00 MB image at 91.89 MB/s Sep 16 13:10:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:16 devstack quobyte-client[83541]: System call of process 91927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:10:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 1G" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5796f7f-30d4-4b6a-b077-8b3b016baaeb]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 0.400s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 1 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Downloaded image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume cf808182-59a6-4c47-a516-65b642056b33 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 for user 273ec08e06a045eb8e561353821e694d is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:10:17 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Marking volume cf808182-59a6-4c47-a516-65b642056b33 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Copying metadata from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 to cf808182-59a6-4c47-a516-65b642056b33. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Creating volume glance metadata for volume cf808182-59a6-4c47-a516-65b642056b33 backed by image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe34251-7ab9-4d55-a10b-057f3dec3b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf808182-59a6-4c47-a516-65b642056b33', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9a7ce6-4319-48d2-94ff-de8706903ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:10:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Volume volume-cf808182-59a6-4c47-a516-65b642056b33 (cf808182-59a6-4c47-a516-65b642056b33): created successfully Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9a7ce6-4319-48d2-94ff-de8706903ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:10:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Flow 'volume_create_manager' (9b462193-0957-4bff-b2a6-a294164e553c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:10:18 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f9a3ad75-239f-4bb9-9a4c-bc7e9a30f42a tempest-TestShelveInstance-1514596829 None] Created volume successfully. Sep 16 13:10:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:10:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:10:28 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[04570baf-2e7b-45d5-989e-9064854f93c1]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:10:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 0.721s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:29 devstack quobyte-client[83541]: System call of process 91962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:10:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 1 in 0.599s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:10:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.528s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:10:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-4f4cf0e1-ac29-4388-bb27-9bd207476776 req-27f7a87f-5865-43ea-8905-2c787a3b65c8 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:10:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-cf808182-59a6-4c47-a516-65b642056b33', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd373823f-4c3f-4d69-9e5c-d15a35123997', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:10:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:10:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-4f4cf0e1-ac29-4388-bb27-9bd207476776 req-27f7a87f-5865-43ea-8905-2c787a3b65c8 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:10:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-4f4cf0e1-ac29-4388-bb27-9bd207476776 req-27f7a87f-5865-43ea-8905-2c787a3b65c8 tempest-AttachVolumeTestJSON-1305521161 None] Terminate volume connection completed successfully. Sep 16 13:10:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-4f4cf0e1-ac29-4388-bb27-9bd207476776 req-27f7a87f-5865-43ea-8905-2c787a3b65c8 tempest-AttachVolumeTestJSON-1305521161 None] Deleting attachment 1c210771-7999-4b64-bdbe-342be8a1590d. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:10:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-50a93fb4-a68a-43dc-8ec7-61eac9673eda req-3a646bad-a006-42f0-8f95-7136cc61a603 tempest-TestShelveInstance-1514596829 None] attachment_update completed successfully. Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13,cinder:INSERT=9 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.186s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:10:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:10:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.165s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:10:42 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:11:09 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-48e647e6-4836-464a-8b33-c00185a65f20 req-be78c8e4-ff64-4381-84ee-6ade9cf85faa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:11:09 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-48e647e6-4836-464a-8b33-c00185a65f20 req-be78c8e4-ff64-4381-84ee-6ade9cf85faa tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:11:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-48e647e6-4836-464a-8b33-c00185a65f20 req-be78c8e4-ff64-4381-84ee-6ade9cf85faa tempest-AttachVolumeShelveTestJSON-681045340 None] Terminate volume connection completed successfully. Sep 16 13:11:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-48e647e6-4836-464a-8b33-c00185a65f20 req-be78c8e4-ff64-4381-84ee-6ade9cf85faa tempest-AttachVolumeShelveTestJSON-681045340 None] Deleting attachment 3a55bf7d-5d43-4320-ab02-61ebf944011d. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:11:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:11:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.169s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:11:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:12:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-2a9c6a09-d286-4ad1-9b5f-a9119e6de7b9 req-2a2b63fc-64ab-45fa-9ab1-d74c27a8ff86 tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:12:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-2a9c6a09-d286-4ad1-9b5f-a9119e6de7b9 req-2a2b63fc-64ab-45fa-9ab1-d74c27a8ff86 tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:12:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-2a9c6a09-d286-4ad1-9b5f-a9119e6de7b9 req-2a2b63fc-64ab-45fa-9ab1-d74c27a8ff86 tempest-TestShelveInstance-1514596829 None] Terminate volume connection completed successfully. Sep 16 13:12:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-2a9c6a09-d286-4ad1-9b5f-a9119e6de7b9 req-2a2b63fc-64ab-45fa-9ab1-d74c27a8ff86 tempest-TestShelveInstance-1514596829 None] Deleting attachment d373823f-4c3f-4d69-9e5c-d15a35123997. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[80158a1d-93f7-4de6-aa39-f826ce6e2a78]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:12:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:12:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 0.839s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:12:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:12:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 1 in 0.632s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:12:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:12:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.882s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:12:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-cf808182-59a6-4c47-a516-65b642056b33', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8138c054-77b0-482c-acba-5b62585d8d13', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:12:31 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:12:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-a2271382-02c6-4bb7-b29d-e7abf12cb1f4 req-c4be9e31-afee-47f1-ad62-0520cb94222d tempest-TestShelveInstance-1514596829 None] attachment_update completed successfully. Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.122s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:12:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:12:42 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=7 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:12:42 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:13:14 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Flow 'volume_create_manager' (38f7ba75-dbdc-4052-94c6-4f5f9c25cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce5c30-25f6-4a68-be46-55e1043eedd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce5c30-25f6-4a68-be46-55e1043eedd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1030607373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08e19a4-34d0-4a94-ba46-a18368450aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eecdf5abcb463f83cf132de0fccc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:13:14Z,use_quota=True,user_id='0e0dd28d054f45adad0df02890ca25db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bd12a4-f240-4832-aec1-39fd302703ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51bd12a4-f240-4832-aec1-39fd302703ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e306adbb-fcc7-4478-8079-baaeb563d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e306adbb-fcc7-4478-8079-baaeb563d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08e19a4-34d0-4a94-ba46-a18368450aa4', 'volume_name': 'volume-f08e19a4-34d0-4a94-ba46-a18368450aa4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed761b-7520-4b72-8247-e4917a67c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed761b-7520-4b72-8247-e4917a67c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b988129-de55-453c-81de-d8be24e5824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:14 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume f08e19a4-34d0-4a94-ba46-a18368450aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08e19a4-34d0-4a94-ba46-a18368450aa4', 'volume_size': 1} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1030607373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08e19a4-34d0-4a94-ba46-a18368450aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9eecdf5abcb463f83cf132de0fccc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:13:14Z,use_quota=True,user_id='0e0dd28d054f45adad0df02890ca25db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Creating volume f08e19a4-34d0-4a94-ba46-a18368450aa4 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:13:14 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:13:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:13:14 devstack quobyte-client[83541]: System call of process 93409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:13:14 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=50, name=volume-f08e19a4-34d0-4a94-ba46-a18368450aa4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 1073741824" returned: 0 in 0.728s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] <== create_volume: return (901ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b988129-de55-453c-81de-d8be24e5824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08e19a4-34d0-4a94-ba46-a18368450aa4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb65889-14c2-4bf1-a8af-2a557c679c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:13:15 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 (f08e19a4-34d0-4a94-ba46-a18368450aa4): created successfully Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb65889-14c2-4bf1-a8af-2a557c679c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:13:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Flow 'volume_create_manager' (38f7ba75-dbdc-4052-94c6-4f5f9c25cfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:13:15 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1a72b5a3-bb60-4f74-b75e-09718dfd0f81 tempest-AttachVolumeShelveTestJSON-681045340 None] Created volume successfully. Sep 16 13:13:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:13:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.110s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:13:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:13:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-11dd3d91-f846-4e84-a219-ec7d7ef49218 req-8d53bae3-2a8b-431c-abff-9f47f2c7d0a2 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:13:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-11dd3d91-f846-4e84-a219-ec7d7ef49218 req-8d53bae3-2a8b-431c-abff-9f47f2c7d0a2 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:13:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-11dd3d91-f846-4e84-a219-ec7d7ef49218 req-8d53bae3-2a8b-431c-abff-9f47f2c7d0a2 tempest-AttachVolumeShelveTestJSON-681045340 None] No connector for attachment 4d187940-14a4-4fdb-91db-1f1c78a70cd2; skipping storage backend terminate_connection call. {{(pid=83513) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 16 13:13:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-11dd3d91-f846-4e84-a219-ec7d7ef49218 req-8d53bae3-2a8b-431c-abff-9f47f2c7d0a2 tempest-AttachVolumeShelveTestJSON-681045340 None] Deleting attachment 4d187940-14a4-4fdb-91db-1f1c78a70cd2. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:13:57 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:13:57 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:14:21 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:21 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:14:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (700618df-1ed6-4f72-8dd7-bddbce5f0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:14:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3086b512-5bc5-4409-a591-2839b204a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3086b512-5bc5-4409-a591-2839b204a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2100125283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5019c-fd0f-4833-ba33-1d058a6dbeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:14:21Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffef21-7855-4846-83e0-fe80b48f01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffef21-7855-4846-83e0-fe80b48f01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad94817-65c1-4bfb-8ec4-db9e53167075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad94817-65c1-4bfb-8ec4-db9e53167075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f5019c-fd0f-4833-ba33-1d058a6dbeb8', 'volume_name': 'volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15236826-27c9-4072-8f14-b21a7c6b443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15236826-27c9-4072-8f14-b21a7c6b443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412a14e-91aa-48b0-8e79-abf6227c4464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Volume 74f5019c-fd0f-4833-ba33-1d058a6dbeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8', 'volume_size': 1} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2100125283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f5019c-fd0f-4833-ba33-1d058a6dbeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:14:21Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Creating volume 74f5019c-fd0f-4833-ba33-1d058a6dbeb8 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:14:22 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:14:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:23 devstack quobyte-client[83541]: System call of process 93817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:14:23 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=51, name=volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 1073741824" returned: 0 in 1.194s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" returned: 0 in 0.172s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] <== create_volume: return (1694ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412a14e-91aa-48b0-8e79-abf6227c4464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1becceea-78fc-4545-a510-9d972bc4bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:24 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Volume volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 (74f5019c-fd0f-4833-ba33-1d058a6dbeb8): created successfully Sep 16 13:14:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1becceea-78fc-4545-a510-9d972bc4bb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (700618df-1ed6-4f72-8dd7-bddbce5f0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:14:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b273c063-3c54-4a5c-8ac8-49a197395fcb tempest-AttachVolumeTestJSON-1305521161 None] Created volume successfully. Sep 16 13:14:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-45f90be1-18fd-4167-9470-6917972095c8 req-a68d6265-0bdf-4a9f-a469-4fa515e9aa8c tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:26 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-45f90be1-18fd-4167-9470-6917972095c8 req-a68d6265-0bdf-4a9f-a469-4fa515e9aa8c tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-45f90be1-18fd-4167-9470-6917972095c8 req-a68d6265-0bdf-4a9f-a469-4fa515e9aa8c tempest-TestShelveInstance-1514596829 None] Terminate volume connection completed successfully. Sep 16 13:14:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-45f90be1-18fd-4167-9470-6917972095c8 req-a68d6265-0bdf-4a9f-a469-4fa515e9aa8c tempest-TestShelveInstance-1514596829 None] Deleting attachment 8138c054-77b0-482c-acba-5b62585d8d13. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:14:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Acquiring lock "cinder-cf808182-59a6-4c47-a516-65b642056b33-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:14:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "cinder-cf808182-59a6-4c47-a516-65b642056b33-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:14:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Acquiring lock "cinder-quobyte-cf808182-59a6-4c47-a516-65b642056b33" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:14:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "cinder-quobyte-cf808182-59a6-4c47-a516-65b642056b33" acquired by "delete_volume" :: waited 0.050s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:14:28 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab5767-57db-47f0-a7ac-31358ac8f660]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:14:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:30 devstack quobyte-client[83541]: System call of process 93855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:14:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 1.790s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:31 devstack quobyte-client[83541]: System call of process 93874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:14:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 1 in 1.196s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:14:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cf808182-59a6-4c47-a516-65b642056b33" returned: 0 in 0.322s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "cinder-quobyte-cf808182-59a6-4c47-a516-65b642056b33" released by "delete_volume" :: held 4.417s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:14:33 devstack cinder-volume[83513]: DEBUG cinder.quota [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Created reservations ['e424b925-5e28-4398-b217-1b10edc92e42', '75bc9421-ea24-441f-aca1-c987e2dc4d49', '47e76f8c-c91b-4128-a44e-52ee729ff654', '56bd0f95-ee4e-4869-8252-b847ca55e506'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.130s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:34 devstack cinder-volume[83513]: DEBUG cinder.manager [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:14:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Deleted volume successfully. Sep 16 13:14:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-45f90be1-18fd-4167-9470-6917972095c8 req-97cd5362-f94c-4112-8dba-f265a8ad9602 tempest-TestShelveInstance-1514596829 None] Lock "cinder-cf808182-59a6-4c47-a516-65b642056b33-delete_volume" released by "delete_volume" :: held 7.365s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:14:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:36 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[04087840-d37d-48b0-a4a4-04cb269c8f90]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:14:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" returned: 0 in 0.735s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.891s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a8bc242-d0d7-4d1b-9802-e8475600fece', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:14:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-cbd509e9-2110-4c88-ae2a-857692493b1f req-30351f17-e339-485a-8264-9695abec964b tempest-AttachVolumeTestJSON-1305521161 None] attachment_update completed successfully. Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.197s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:14:45 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:45 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (d7a85301-6f87-470f-8fcc-23eebe74501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef20ff26-0113-4383-9364-053101490a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef20ff26-0113-4383-9364-053101490a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1660155357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3787006-04f6-4768-8ac3-7304cc144a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:14:45Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ded15-efbc-48f5-a9b1-2b99207e16ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2ded15-efbc-48f5-a9b1-2b99207e16ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc70030-adc8-4c0d-acbf-e43b78f4fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc70030-adc8-4c0d-acbf-e43b78f4fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3787006-04f6-4768-8ac3-7304cc144a48', 'volume_name': 'volume-b3787006-04f6-4768-8ac3-7304cc144a48', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc36394-954e-4497-a205-6a6a35c69dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc36394-954e-4497-a205-6a6a35c69dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa3cd68-d7b6-44f0-a921-002d2c3c5a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:46 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Volume b3787006-04f6-4768-8ac3-7304cc144a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3787006-04f6-4768-8ac3-7304cc144a48', 'volume_size': 1} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1660155357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3787006-04f6-4768-8ac3-7304cc144a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab2440daef048c9a365002b6a04bcd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:14:45Z,use_quota=True,user_id='00852d9f2f74404dacc3b08aee483246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Creating volume b3787006-04f6-4768-8ac3-7304cc144a48 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:14:46 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:46 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=52, name=volume-b3787006-04f6-4768-8ac3-7304cc144a48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 1073741824" returned: 0 in 0.624s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48" returned: 0 in 0.118s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa3cd68-d7b6-44f0-a921-002d2c3c5a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3787006-04f6-4768-8ac3-7304cc144a48', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756d4e5-addc-4ad5-8cdb-5e00704811cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:14:47 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Volume volume-b3787006-04f6-4768-8ac3-7304cc144a48 (b3787006-04f6-4768-8ac3-7304cc144a48): created successfully Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756d4e5-addc-4ad5-8cdb-5e00704811cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:14:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Flow 'volume_create_manager' (d7a85301-6f87-470f-8fcc-23eebe74501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:14:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9fbf10d8-67a6-4e94-96c9-9a3934d66383 tempest-AttachVolumeTestJSON-1305521161 None] Created volume successfully. Sep 16 13:14:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:14:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:14:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50e194-d390-4127-a3e2-89415c221320]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:14:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:14:54 devstack quobyte-client[83541]: System call of process 94354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:14:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48" returned: 0 in 0.730s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:14:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:14:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-b3787006-04f6-4768-8ac3-7304cc144a48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '834917df-2d33-4568-bd52-53d5b0a773f1', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:14:55 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:14:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-a330034d-87e0-429c-8e42-0b0926940131 req-f6e84414-23a9-40ed-827c-0e96f2f9691a tempest-AttachVolumeTestJSON-1305521161 None] attachment_update completed successfully. Sep 16 13:15:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (21c3573f-2b9c-4efb-8b15-72201f0e6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf05df7-c597-4872-b6d4-a2ac0a34cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf05df7-c597-4872-b6d4-a2ac0a34cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039015187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba8b2a4-112f-4ca8-81df-2ad55f24dd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:01Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4814bdca-6f70-470c-bc80-ed4b9fb479d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4814bdca-6f70-470c-bc80-ed4b9fb479d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d699583d-9990-4101-96a5-94a8704b5659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d699583d-9990-4101-96a5-94a8704b5659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba8b2a4-112f-4ca8-81df-2ad55f24dd08', 'volume_name': 'volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483f28fa-09e2-49c5-908c-f36673a35742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483f28fa-09e2-49c5-908c-f36673a35742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87c2661-5935-4edd-87dc-4fbed0cf6852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:01 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume 9ba8b2a4-112f-4ca8-81df-2ad55f24dd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08', 'volume_size': 1} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1039015187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba8b2a4-112f-4ca8-81df-2ad55f24dd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:01Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume 9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:01 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:01 devstack quobyte-client[83541]: System call of process 94396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:15:01 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=53, name=volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 1073741824" returned: 0 in 0.442s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" returned: 0 in 0.140s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87c2661-5935-4edd-87dc-4fbed0cf6852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7de2d-92d5-4fbf-87bc-92cef9465b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 (9ba8b2a4-112f-4ca8-81df-2ad55f24dd08): created successfully Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7de2d-92d5-4fbf-87bc-92cef9465b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (21c3573f-2b9c-4efb-8b15-72201f0e6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f991e735-d86a-4e47-8852-1f3a235ae6a1 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (1af19922-9c8b-4beb-a958-e22219b76075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de42336-b766-45b4-97d3-b1becea500fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de42336-b766-45b4-97d3-b1becea500fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909552371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf52658-67e5-42a7-b90b-8e7280df18ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:04Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c03bb8d-21b7-4804-9c15-47b3da53627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c03bb8d-21b7-4804-9c15-47b3da53627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156707f8-bf40-4b3a-aaeb-5061d29a2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156707f8-bf40-4b3a-aaeb-5061d29a2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf52658-67e5-42a7-b90b-8e7280df18ba', 'volume_name': 'volume-cbf52658-67e5-42a7-b90b-8e7280df18ba', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e84021-b25c-488c-8030-e41969f57338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e84021-b25c-488c-8030-e41969f57338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73757ae7-32e9-4db0-b21d-2d3734e87331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:04 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume cbf52658-67e5-42a7-b90b-8e7280df18ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf52658-67e5-42a7-b90b-8e7280df18ba', 'volume_size': 1} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909552371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf52658-67e5-42a7-b90b-8e7280df18ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:04Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume cbf52658-67e5-42a7-b90b-8e7280df18ba {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:04 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:05 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=54, name=volume-cbf52658-67e5-42a7-b90b-8e7280df18ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba 1073741824" returned: 0 in 0.642s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:05 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:05 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (073390fc-7f25-433b-8b1e-af8fc2ad71c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fa6fc5-8782-4731-b256-9bb0707b5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba" returned: 0 in 0.758s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (1451ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fa6fc5-8782-4731-b256-9bb0707b5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856673066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e676aecf-1216-492b-a83a-a465f0b2b311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:05Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d4a291-771e-4bcb-a2b9-ff3424c1e2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d4a291-771e-4bcb-a2b9-ff3424c1e2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78699c3c-68e9-43bf-9b75-025ac5b29501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78699c3c-68e9-43bf-9b75-025ac5b29501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e676aecf-1216-492b-a83a-a465f0b2b311', 'volume_name': 'volume-e676aecf-1216-492b-a83a-a465f0b2b311', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1052682-06ae-4dde-b0cc-95faa6bc8421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1052682-06ae-4dde-b0cc-95faa6bc8421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c34d19-7d56-46e7-916e-7fe9d972a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume e676aecf-1216-492b-a83a-a465f0b2b311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e676aecf-1216-492b-a83a-a465f0b2b311', 'volume_size': 1} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1856673066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e676aecf-1216-492b-a83a-a465f0b2b311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:05Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume e676aecf-1216-492b-a83a-a465f0b2b311 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:06 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:06 devstack quobyte-client[83541]: System call of process 94417 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:15:06 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=55, name=volume-e676aecf-1216-492b-a83a-a465f0b2b311, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73757ae7-32e9-4db0-b21d-2d3734e87331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf52658-67e5-42a7-b90b-8e7280df18ba', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5879ba6-76d8-415a-ada8-f778238e27ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (84d0cc3c-0966-4a90-bdd6-d042830e972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c11e6eb-2262-482b-aea2-8f8b0859f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (6c5c81c2-0c99-429d-8e54-a11aa3f2e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a6811-9351-4dc9-9a84-c8d7ffd0d96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28a6811-9351-4dc9-9a84-c8d7ffd0d96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758419783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7860287-134a-4ced-ab59-ccf12f46d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:06Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74679863-635c-4db0-bbad-985cc7421756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74679863-635c-4db0-bbad-985cc7421756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228a5553-19f3-4508-97ea-462cddd0ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228a5553-19f3-4508-97ea-462cddd0ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7860287-134a-4ced-ab59-ccf12f46d948', 'volume_name': 'volume-c7860287-134a-4ced-ab59-ccf12f46d948', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712c4fe8-d875-48a8-bbdc-773888d5f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712c4fe8-d875-48a8-bbdc-773888d5f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35571fd2-aff2-4635-915b-ff7d0d75784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume c7860287-134a-4ced-ab59-ccf12f46d948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7860287-134a-4ced-ab59-ccf12f46d948', 'volume_size': 1} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-cbf52658-67e5-42a7-b90b-8e7280df18ba (cbf52658-67e5-42a7-b90b-8e7280df18ba): created successfully Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5879ba6-76d8-415a-ada8-f778238e27ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (1af19922-9c8b-4beb-a958-e22219b76075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311 1073741824" returned: 0 in 1.066s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c11e6eb-2262-482b-aea2-8f8b0859f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439772714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c3db3-d658-4a3a-8911-055f3546395e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:06Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f207dbf1-18d7-4b4d-92ec-bd9c0d19e78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f207dbf1-18d7-4b4d-92ec-bd9c0d19e78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab9d8c-51fc-47bb-8745-2395e80160cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab9d8c-51fc-47bb-8745-2395e80160cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795c3db3-d658-4a3a-8911-055f3546395e', 'volume_name': 'volume-795c3db3-d658-4a3a-8911-055f3546395e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5cc06-7473-4839-b2c4-f83adc5ab105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5cc06-7473-4839-b2c4-f83adc5ab105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7c1549-5b13-4212-ae84-a7dd098e52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume 795c3db3-d658-4a3a-8911-055f3546395e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795c3db3-d658-4a3a-8911-055f3546395e', 'volume_size': 1} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4c4f812b-18dd-4053-93d5-b146db868851 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (9f118713-a60a-48b9-bdbd-e60c96a04436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de25e3fd-e90b-40d6-94ff-6c4afbc92d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311" returned: 0 in 0.437s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de25e3fd-e90b-40d6-94ff-6c4afbc92d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240704142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9696598-10b6-47da-9c29-0f23922174a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:07Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94612c7c-0659-4044-a6e5-4702b0f9a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94612c7c-0659-4044-a6e5-4702b0f9a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a62855a-0f23-435d-8ff3-c4d6e2ddd808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a62855a-0f23-435d-8ff3-c4d6e2ddd808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9696598-10b6-47da-9c29-0f23922174a5', 'volume_name': 'volume-e9696598-10b6-47da-9c29-0f23922174a5', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9f24a3-1bfe-4bcc-af78-b2901eef05dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9f24a3-1bfe-4bcc-af78-b2901eef05dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc97e9b-954d-48e0-af74-0b438b98af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume e9696598-10b6-47da-9c29-0f23922174a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9696598-10b6-47da-9c29-0f23922174a5', 'volume_size': 1} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (1632ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758419783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7860287-134a-4ced-ab59-ccf12f46d948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:06Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume c7860287-134a-4ced-ab59-ccf12f46d948 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:07 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c34d19-7d56-46e7-916e-7fe9d972a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e676aecf-1216-492b-a83a-a465f0b2b311', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:08 devstack quobyte-client[83541]: System call of process 94421 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589ad819-1132-47df-ae9a-5902882c6d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:08 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=56, name=volume-c7860287-134a-4ced-ab59-ccf12f46d948, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:08 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-e676aecf-1216-492b-a83a-a465f0b2b311 (e676aecf-1216-492b-a83a-a465f0b2b311): created successfully Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589ad819-1132-47df-ae9a-5902882c6d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (073390fc-7f25-433b-8b1e-af8fc2ad71c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:08 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c6783fb9-aee5-4132-afe6-8d0e2dbc70ba tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948 1073741824" returned: 0 in 0.571s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948" returned: 0 in 0.170s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (780ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439772714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c3db3-d658-4a3a-8911-055f3546395e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:06Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume 795c3db3-d658-4a3a-8911-055f3546395e {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:08 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:08 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=57, name=volume-795c3db3-d658-4a3a-8911-055f3546395e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35571fd2-aff2-4635-915b-ff7d0d75784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7860287-134a-4ced-ab59-ccf12f46d948', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d15e99-30d8-4df3-92f2-aa8e7ce6c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e 1073741824" returned: 0 in 0.428s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-c7860287-134a-4ced-ab59-ccf12f46d948 (c7860287-134a-4ced-ab59-ccf12f46d948): created successfully Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d15e99-30d8-4df3-92f2-aa8e7ce6c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (6c5c81c2-0c99-429d-8e54-a11aa3f2e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e" returned: 0 in 0.398s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1240704142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9696598-10b6-47da-9c29-0f23922174a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c0e4ce31974e4b9e2e1501eb2f08f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:15:07Z,use_quota=True,user_id='b969e909387c4c1eb87dfaad7ae44404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Creating volume e9696598-10b6-47da-9c29-0f23922174a5 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:15:09 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=58, name=volume-e9696598-10b6-47da-9c29-0f23922174a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:15:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b8565df9-5f30-4e95-a6de-2667346f4bdf tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7c1549-5b13-4212-ae84-a7dd098e52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795c3db3-d658-4a3a-8911-055f3546395e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f92dd32-9df1-42bd-9c49-b919d7296bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-795c3db3-d658-4a3a-8911-055f3546395e (795c3db3-d658-4a3a-8911-055f3546395e): created successfully Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f92dd32-9df1-42bd-9c49-b919d7296bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (84d0cc3c-0966-4a90-bdd6-d042830e972c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-96dda5ef-d999-42b6-aef2-789f11cdb908 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5 1073741824" returned: 0 in 0.451s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5" returned: 0 in 0.167s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] <== create_volume: return (657ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc97e9b-954d-48e0-af74-0b438b98af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9696598-10b6-47da-9c29-0f23922174a5', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa1890d-a0d8-43a5-ab2f-9400d6499288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:15:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume volume-e9696598-10b6-47da-9c29-0f23922174a5 (e9696598-10b6-47da-9c29-0f23922174a5): created successfully Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa1890d-a0d8-43a5-ab2f-9400d6499288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:15:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Flow 'volume_create_manager' (9f118713-a60a-48b9-bdbd-e60c96a04436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:15:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ce4c0c28-cfe5-4796-90d6-5a5c99d3c270 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created volume successfully. Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-e9696598-10b6-47da-9c29-0f23922174a5-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-e9696598-10b6-47da-9c29-0f23922174a5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-e9696598-10b6-47da-9c29-0f23922174a5" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-e9696598-10b6-47da-9c29-0f23922174a5" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442651c-d1ac-4853-b831-14daac7a6986]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5" returned: 0 in 0.423s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e9696598-10b6-47da-9c29-0f23922174a5" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-e9696598-10b6-47da-9c29-0f23922174a5" released by "delete_volume" :: held 0.642s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['bebd770c-0096-4ba0-b5b4-09fea358b0ae', '03ef8b64-e261-4d88-9688-36db3e9c5574', 'fcfb5390-feb2-4b45-ac47-c5a153a2c4a8', '2ddef1a9-755e-484b-8c41-ed38f7d50580'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8a732aef-411c-4e2c-add6-9a561b53768e tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-e9696598-10b6-47da-9c29-0f23922174a5-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-c7860287-134a-4ced-ab59-ccf12f46d948-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-c7860287-134a-4ced-ab59-ccf12f46d948-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-c7860287-134a-4ced-ab59-ccf12f46d948" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-c7860287-134a-4ced-ab59-ccf12f46d948" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f898558-3543-4394-b11c-30cf3c3f44a1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948" returned: 0 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c7860287-134a-4ced-ab59-ccf12f46d948" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-c7860287-134a-4ced-ab59-ccf12f46d948" released by "delete_volume" :: held 0.630s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['9a65cd81-b2f9-4e80-9026-60ad87b86d61', '4ffb23e1-d54c-4b7e-8a65-8bef431180e2', '62bebb92-aa6e-419d-8fe6-217d26702d26', '07efb82d-eca9-4061-8e3a-dbc9287a01e6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.250s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:14 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f1e1affb-c757-45c3-879a-937e310fd895 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-c7860287-134a-4ced-ab59-ccf12f46d948-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-795c3db3-d658-4a3a-8911-055f3546395e-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-795c3db3-d658-4a3a-8911-055f3546395e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-795c3db3-d658-4a3a-8911-055f3546395e" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-795c3db3-d658-4a3a-8911-055f3546395e" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3d3ac-73e2-412f-b1bd-f2cfbd0bae42]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e" returned: 0 in 0.442s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-795c3db3-d658-4a3a-8911-055f3546395e" returned: 0 in 0.104s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-795c3db3-d658-4a3a-8911-055f3546395e" released by "delete_volume" :: held 0.687s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['4a9eb14d-0a24-4fa3-8e01-cfb598ac1521', '4c53c074-2a55-442b-8996-6c8ac404143b', '71dd21d7-89d9-4156-bd30-6105f8ce7874', '28046d53-39f0-4cda-b7ef-f974b970e67e'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:16 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ad530ec7-691a-4b31-aee7-3375a87c1577 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-795c3db3-d658-4a3a-8911-055f3546395e-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-e676aecf-1216-492b-a83a-a465f0b2b311-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-e676aecf-1216-492b-a83a-a465f0b2b311-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-e676aecf-1216-492b-a83a-a465f0b2b311" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-e676aecf-1216-492b-a83a-a465f0b2b311" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[981fd84f-ccac-4544-b397-da970073492e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311" returned: 0 in 0.444s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e676aecf-1216-492b-a83a-a465f0b2b311" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-e676aecf-1216-492b-a83a-a465f0b2b311" released by "delete_volume" :: held 0.718s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=44,cinder:UPDATE=44,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:15:18 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=60,cinder:DELETE=8,cinder:SELECT=41,cinder:INSERT=10 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['5a1aab8e-6869-464d-9089-ba1ca3e9fa99', 'c81b19e5-2904-4f2f-aa90-bf1717a7333d', '15cd848a-15e0-40a8-b574-0628eb31d3af', '018c035f-d690-4917-af61-60fd9d1dcb6b'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.091s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-974ab4f5-9c71-43d1-b53d-b9c04695256c tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-e676aecf-1216-492b-a83a-a465f0b2b311-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-cbf52658-67e5-42a7-b90b-8e7280df18ba-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-cbf52658-67e5-42a7-b90b-8e7280df18ba-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-cbf52658-67e5-42a7-b90b-8e7280df18ba" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-cbf52658-67e5-42a7-b90b-8e7280df18ba" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a1d08-808e-4e52-90b0-64349539ee28]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba" returned: 0 in 0.454s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cbf52658-67e5-42a7-b90b-8e7280df18ba" returned: 0 in 0.115s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-cbf52658-67e5-42a7-b90b-8e7280df18ba" released by "delete_volume" :: held 0.757s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['9e363578-75a8-48c1-8530-d354f2e26684', 'f8540420-fc68-4b16-a751-e7d408549b4c', '66a245c4-096a-4390-b94e-baac8df54443', '1f0d91f0-7dc6-4738-a8ad-d344254037ca'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.093s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:21 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c8a3634c-6ca1-4014-829e-064404fa2fbb tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-cbf52658-67e5-42a7-b90b-8e7280df18ba-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "cinder-quobyte-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7207d0ed-2ba8-4bdf-bbf4-1f775ed29a6e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" returned: 0 in 0.433s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-quobyte-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08" released by "delete_volume" :: held 0.675s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:23 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Created reservations ['3d6de9fd-c4cd-46e6-9c7d-0684769f27a6', 'c18bd4f9-cea9-4a03-a812-d92ff956a6f5', '7102c6a3-e0b1-4329-8fe0-5f60e426b730', 'd26dea28-52af-43c5-a2b5-c1a0db4afef9'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Deleted volume successfully. Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c15e7fe-144b-427c-84a2-eda235df5db2 tempest-CreateVolumesFromSourceVolumeTest-1881538285 None] Lock "cinder-9ba8b2a4-112f-4ca8-81df-2ad55f24dd08-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-1afcbfb0-6242-40bd-9391-06fe9dc990ab req-bf58b48f-1213-41f1-9bb6-1736db8a6c87 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-1afcbfb0-6242-40bd-9391-06fe9dc990ab req-bf58b48f-1213-41f1-9bb6-1736db8a6c87 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-1afcbfb0-6242-40bd-9391-06fe9dc990ab req-bf58b48f-1213-41f1-9bb6-1736db8a6c87 tempest-AttachVolumeTestJSON-1305521161 None] Terminate volume connection completed successfully. Sep 16 13:15:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-1afcbfb0-6242-40bd-9391-06fe9dc990ab req-bf58b48f-1213-41f1-9bb6-1736db8a6c87 tempest-AttachVolumeTestJSON-1305521161 None] Deleting attachment 3a8bc242-d0d7-4d1b-9802-e8475600fece. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:15:34 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:15:34 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:INSERT=8,cinder:UPDATE=22,cinder:SELECT=18,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.087s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "cinder-f08e19a4-34d0-4a94-ba46-a18368450aa4-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-f08e19a4-34d0-4a94-ba46-a18368450aa4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "cinder-quobyte-f08e19a4-34d0-4a94-ba46-a18368450aa4" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-quobyte-f08e19a4-34d0-4a94-ba46-a18368450aa4" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076b90f-2a72-4b25-9adc-ad8ff56cee3e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4" returned: 0 in 0.400s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f08e19a4-34d0-4a94-ba46-a18368450aa4" returned: 0 in 0.077s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-quobyte-f08e19a4-34d0-4a94-ba46-a18368450aa4" released by "delete_volume" :: held 0.622s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Created reservations ['f7814236-7be0-49d5-a739-9e94b0ee8137', '033608d6-a1af-40eb-b747-5408c08e7b45', '8484d1af-d099-4582-9557-5d6020e77a41', 'ce403126-4a37-4a3e-abeb-97c9b881997f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.085s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:48 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:48 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Deleted volume successfully. Sep 16 13:15:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bba19a03-6089-428c-b20a-597b71a4a969 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-f08e19a4-34d0-4a94-ba46-a18368450aa4-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "cinder-202bc23d-f53f-4854-9f27-ae1bdef18434-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-202bc23d-f53f-4854-9f27-ae1bdef18434-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-2b98d229-e9d3-4514-9184-cdd80ad1f411 req-ea30e221-6ffe-44c4-bf16-77ec61474c11 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "cinder-quobyte-202bc23d-f53f-4854-9f27-ae1bdef18434" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:15:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-2b98d229-e9d3-4514-9184-cdd80ad1f411 req-ea30e221-6ffe-44c4-bf16-77ec61474c11 tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:15:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-2b98d229-e9d3-4514-9184-cdd80ad1f411 req-ea30e221-6ffe-44c4-bf16-77ec61474c11 tempest-AttachVolumeTestJSON-1305521161 None] Terminate volume connection completed successfully. Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-2b98d229-e9d3-4514-9184-cdd80ad1f411 req-ea30e221-6ffe-44c4-bf16-77ec61474c11 tempest-AttachVolumeTestJSON-1305521161 None] Deleting attachment 834917df-2d33-4568-bd52-53d5b0a773f1. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-quobyte-202bc23d-f53f-4854-9f27-ae1bdef18434" acquired by "delete_volume" :: waited 0.043s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a44ccab-6e58-4899-8c2b-5a76862b3835]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434" returned: 0 in 0.414s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-202bc23d-f53f-4854-9f27-ae1bdef18434" returned: 0 in 0.127s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-quobyte-202bc23d-f53f-4854-9f27-ae1bdef18434" released by "delete_volume" :: held 0.691s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Created reservations ['fd82b442-23dc-4e83-b8c5-2a9372f35062', '1f611001-567a-4b51-b242-978067bfca31', 'e50b96f8-4f07-43b9-80b7-41925102afa4', '4d135d5c-d008-4a55-bdca-92539021eaab'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:15:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Deleted volume successfully. Sep 16 13:15:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c34fa77e-7633-423a-a981-1cd89385cef4 tempest-AttachVolumeShelveTestJSON-681045340 None] Lock "cinder-202bc23d-f53f-4854-9f27-ae1bdef18434-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:16:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:16:02 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b761ce2a-5d4e-48e1-9a7c-90c5f72530f6 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b761ce2a-5d4e-48e1-9a7c-90c5f72530f6 tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-849177239: creating Sep 16 13:16:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b761ce2a-5d4e-48e1-9a7c-90c5f72530f6 tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-849177239: created successfully Sep 16 13:16:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b761ce2a-5d4e-48e1-9a7c-90c5f72530f6 tempest-GroupSnapshotsTest-1819787857 None] Create group completed successfully. Sep 16 13:16:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (a62d803e-b5a9-4128-aad6-d1d5f466353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424ef481-b9db-4c47-be32-d025cdf5ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424ef481-b9db-4c47-be32-d025cdf5ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510646823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67164fe6-9989-4515-adf1-54ccfb548c12,host='devstack@QuobyteHD#QuobyteHD',id=e470f621-6d19-433b-b373-4f4095536068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:04Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab6e20c-7f2f-4ffb-a66d-53d5d55bc46e),volume_type_id=0ab6e20c-7f2f-4ffb-a66d-53d5d55bc46e)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d17414-8f3c-43c5-b12f-4bd75e6a8f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d17414-8f3c-43c5-b12f-4bd75e6a8f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439434d2-fa44-469e-8c83-d8f6a2b929ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439434d2-fa44-469e-8c83-d8f6a2b929ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e470f621-6d19-433b-b373-4f4095536068', 'volume_name': 'volume-e470f621-6d19-433b-b373-4f4095536068', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e73ad4-70db-4182-9e55-ef18ccac773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e73ad4-70db-4182-9e55-ef18ccac773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c851cdc-404d-434d-95ea-36b59ff594e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:04 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Volume e470f621-6d19-433b-b373-4f4095536068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e470f621-6d19-433b-b373-4f4095536068', 'volume_size': 1} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67164fe6-9989-4515-adf1-54ccfb548c12,created_at=2025-09-16T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510646823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67164fe6-9989-4515-adf1-54ccfb548c12,host='devstack@QuobyteHD#QuobyteHD',id=e470f621-6d19-433b-b373-4f4095536068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:04Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab6e20c-7f2f-4ffb-a66d-53d5d55bc46e),volume_type_id=0ab6e20c-7f2f-4ffb-a66d-53d5d55bc46e)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Creating volume e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:16:04 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:04 devstack quobyte-client[83541]: System call of process 94642 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:04 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=59, name=volume-e470f621-6d19-433b-b373-4f4095536068, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 1073741824" returned: 0 in 0.368s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.115s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:16:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-b3787006-04f6-4768-8ac3-7304cc144a48-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c851cdc-404d-434d-95ea-36b59ff594e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e470f621-6d19-433b-b373-4f4095536068', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ba15e2-3edf-4e5f-ab8e-e0d1b2c743ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-b3787006-04f6-4768-8ac3-7304cc144a48-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:05 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Volume volume-e470f621-6d19-433b-b373-4f4095536068 (e470f621-6d19-433b-b373-4f4095536068): created successfully Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ba15e2-3edf-4e5f-ab8e-e0d1b2c743ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (a62d803e-b5a9-4128-aad6-d1d5f466353d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:05 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e68269fa-0046-4f46-b182-a52ab277fd69 tempest-GroupSnapshotsTest-1819787857 None] Created volume successfully. Sep 16 13:16:05 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-quobyte-b3787006-04f6-4768-8ac3-7304cc144a48" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-b3787006-04f6-4768-8ac3-7304cc144a48" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec20333-11ed-430b-b458-98ef74916a17]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48" returned: 0 in 0.394s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b3787006-04f6-4768-8ac3-7304cc144a48" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-b3787006-04f6-4768-8ac3-7304cc144a48" released by "delete_volume" :: held 0.646s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:06 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Created reservations ['94e6cece-064b-4660-8808-f6cea68e622b', 'e08118a5-8575-445d-a787-69573f3270ea', '2f339f20-8cf2-45f3-be7a-39fd8c3717b8', '5c5a3117-63c7-4c2c-87b1-52fa9b6f0773'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] GroupSnapshot 532c5565-766e-425e-83f1-d932360a1cc2: creating. Sep 16 13:16:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Group snapshot 532c5565-766e-425e-83f1-d932360a1cc2: creating. {{(pid=83513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.534s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Deleted volume successfully. Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-74f5019c-fd0f-4833-ba33-1d058a6dbeb8-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Creating offline snapshot 0c43e21b-f05c-4028-aa27-d53281b18cfb of volume e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fd3e0a05-555f-4766-818f-fbb34d34695a tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-b3787006-04f6-4768-8ac3-7304cc144a48-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd996d2d-8115-4496-a7ad-ef106b52359a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-74f5019c-fd0f-4833-ba33-1d058a6dbeb8-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-quobyte-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" acquired by "delete_volume" :: waited 0.040s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529f8f3-c025-408e-90aa-084ceb182de6]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.587s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:08 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=60, name=volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb 1G" returned: 0 in 0.299s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e470f621-6d19-433b-b373-4f4095536068 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" returned: 0 in 0.590s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img rebase -u -b volume-e470f621-6d19-433b-b373-4f4095536068 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.232s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" returned: 0 in 0.165s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.143s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-74f5019c-fd0f-4833-ba33-1d058a6dbeb8" released by "delete_volume" :: held 1.048s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.273s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.info" returned: 0 in 0.253s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.info" returned: 0 in 0.167s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Created reservations ['cbf2380f-b3e9-42b9-a533-196240be37e2', '0ec31bd7-f6e2-44f0-bb3d-405138840541', '4ba4d991-b281-4254-8a34-641a8f7442e7', '0e934060-8182-4ebf-8091-cfd52132904d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bbc61f04-4be3-49fc-b3d5-d4ad2fe5bd54 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 532c5565-766e-425e-83f1-d932360a1cc2: created successfully Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Deleted volume successfully. Sep 16 13:16:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e0ebc934-8d21-429d-add0-cfe7b760df6b tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-74f5019c-fd0f-4833-ba33-1d058a6dbeb8-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-c819178b-4539-4211-85e8-4204a52c399a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-c819178b-4539-4211-85e8-4204a52c399a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "cinder-quobyte-c819178b-4539-4211-85e8-4204a52c399a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-c819178b-4539-4211-85e8-4204a52c399a" acquired by "delete_volume" :: waited 0.009s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb40f1c-cedd-4002-9f64-759157b83449]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a" returned: 0 in 0.731s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb-cdef1a56-c7c6-496f-9fc6-022d9303177f" by "_create_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c819178b-4539-4211-85e8-4204a52c399a" returned: 0 in 0.341s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-quobyte-c819178b-4539-4211-85e8-4204a52c399a" released by "delete_volume" :: held 1.167s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb-cdef1a56-c7c6-496f-9fc6-022d9303177f" acquired by "_create_volume_from_snapshot" :: waited 0.115s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Creating volume cdef1a56-c7c6-496f-9fc6-022d9303177f from snapshot 0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:359}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" by "_copy_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" acquired by "_copy_volume_from_snapshot" :: waited 0.076s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] snapshot: 0c43e21b-f05c-4028-aa27-d53281b18cfb, volume: cdef1a56-c7c6-496f-9fc6-022d9303177f, {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:404}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Created reservations ['81f23bc2-6da0-4a40-897b-678837151282', '74ddac86-12d5-4b2c-bb21-7547c6100685', '584d44f2-3578-4ca5-945e-f03c146146e4', '208e4303-71e3-4dd0-9198-ee4bea5b2a46'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94581ec-3b67-4324-a4e1-37835298f345]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.123s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:13 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Deleted volume successfully. Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.910s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e470f621-6d19-433b-b373-4f4095536068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] will copy from snapshot at /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Creating direct copy from snapshot {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5882a6ef-7c6d-4bc4-84c3-e13bffca1694]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:14 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c68b0974-04e6-4687-a253-8b00f7257e2c tempest-AttachVolumeTestJSON-1305521161 None] Lock "cinder-c819178b-4539-4211-85e8-4204a52c399a-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.635s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:14 devstack cinder-volume[83513]: DEBUG cinder.utils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f not found in is_blk_device check {{(pid=83513) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 13:16:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:14 devstack quobyte-client[83541]: System call of process 94687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:14 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=62, name=volume-cdef1a56-c7c6-496f-9fc6-022d9303177f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f" returned: 0 in 7.133s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044f99d-301d-43ce-8b16-aaaf45283d94]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.614s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:16:22 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Converted 1024.00 MB image at 143.00 MB/s Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" released by "_copy_volume_from_snapshot" :: held 9.928s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb-cdef1a56-c7c6-496f-9fc6-022d9303177f" released by "_create_volume_from_snapshot" :: held 10.031s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.162s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:23 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cc9f1d3e-861a-4fa1-a706-5334fb681a87 tempest-GroupSnapshotsTest-1819787857 None] Create group from source-snapshot-532c5565-766e-425e-83f1-d932360a1cc2 completed successfully. Sep 16 13:16:24 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c85dd9-8188-44b5-a72c-a623fb558e12]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f" returned: 0 in 0.515s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cdef1a56-c7c6-496f-9fc6-022d9303177f" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-cdef1a56-c7c6-496f-9fc6-022d9303177f" released by "delete_volume" :: held 0.855s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['97708d64-ea99-48c5-a845-ff345ebe8338'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:25 devstack cinder-volume[83513]: WARNING cinder.quota [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1852673049 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1852673049, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:16:25 devstack cinder-volume[83513]: WARNING cinder.quota [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1852673049 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1852673049, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['0d2d3c26-0910-4459-9861-28b73c817582', 'e21a46b0-9ee7-42af-ac13-e1bab3bd79bd', 'f15f3eff-2494-4b14-8e3f-a8a25c10ad5f', 'e33263d0-dc4b-44ab-80e7-d540c7cd9ca4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.092s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e3f2cb04-d3e9-4970-9116-d180eee09de0 tempest-GroupSnapshotsTest-1819787857 None] Delete group completed successfully. Sep 16 13:16:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 532c5565-766e-425e-83f1-d932360a1cc2: deleting Sep 16 13:16:26 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 532c5565-766e-425e-83f1-d932360a1cc2: deleting {{(pid=83513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Deleting offline snapshot 0c43e21b-f05c-4028-aa27-d53281b18cfb of volume e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] snapshot_file for this snap is: volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b9e7c-95db-4a44-b5aa-c73e36012e86]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.618s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e470f621-6d19-433b-b373-4f4095536068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83a8970-2ac3-4fa8-b89f-7e6b05989c58]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.642s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:28 devstack quobyte-client[83541]: System call of process 94737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.291s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068.0c43e21b-f05c-4028-aa27-d53281b18cfb" returned: 0 in 0.129s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-0c43e21b-f05c-4028-aa27-d53281b18cfb" released by "_delete_snapshot" :: held 2.151s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" released by "delete_snapshot" :: held 2.238s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:30 devstack cinder-volume[83513]: WARNING cinder.quota [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1852673049 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1852673049, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:16:30 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['bb7c7db3-3cc8-4054-ab34-364b3e88c0d3', '8a33601b-5c85-4332-8b0e-711acb432d4c', '0606e4b3-c414-41c7-93b6-4d245e065782', '70de9756-9d54-4005-bd65-a2bf06e6f2f4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9ffea5d5-e808-410e-ad2b-034950aaf28a tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 532c5565-766e-425e-83f1-d932360a1cc2: deleted successfully Sep 16 13:16:31 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" acquired by "delete_volume" :: waited 0.039s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:31 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32785f2-2b1b-48dc-b9a5-20b68e53484b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.487s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e470f621-6d19-433b-b373-4f4095536068" returned: 0 in 0.099s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-e470f621-6d19-433b-b373-4f4095536068" released by "delete_volume" :: held 0.785s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:32 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['596b2047-f7f3-4c0c-817b-dfa3ed485fbd'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:33 devstack cinder-volume[83513]: WARNING cinder.db.sqlalchemy.api [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1852673049'] Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['390d5ff6-79e0-4476-86cd-07449814cf0a', '5fff7800-25fc-4663-ab6f-7a566b301163', 'f4bc1acd-9b18-430c-a991-22c533439822', '39c949aa-daee-4656-9f16-ac1e902b7a00'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:33 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:33 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6c216726-0150-43ba-ac03-cac17eea6ecd tempest-GroupSnapshotsTest-1819787857 None] Delete group completed successfully. Sep 16 13:16:35 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fe868d1d-da32-4de8-9ef9-63c8579fb613 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fe868d1d-da32-4de8-9ef9-63c8579fb613 tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-7314762: creating Sep 16 13:16:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fe868d1d-da32-4de8-9ef9-63c8579fb613 tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-7314762: created successfully Sep 16 13:16:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fe868d1d-da32-4de8-9ef9-63c8579fb613 tempest-GroupSnapshotsTest-1819787857 None] Create group completed successfully. Sep 16 13:16:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (0b6e5857-85a0-4180-9e5e-4cab11095216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa43b495-3048-46d2-8583-52f6bf9ea3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa43b495-3048-46d2-8583-52f6bf9ea3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491410695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=793efa88-43dc-4d12-b887-5d9d4974382a,host='devstack@QuobyteHD#QuobyteHD',id=78946ce2-e698-45fc-95f6-122e023ee474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:36Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3003f790-a8b1-45a9-92c1-35edc3abb8cd),volume_type_id=3003f790-a8b1-45a9-92c1-35edc3abb8cd)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc252be-9d3e-4cdd-9376-88d908a9bdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc252be-9d3e-4cdd-9376-88d908a9bdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61231d7d-7c7c-40f6-9ded-05631c4ee0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61231d7d-7c7c-40f6-9ded-05631c4ee0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78946ce2-e698-45fc-95f6-122e023ee474', 'volume_name': 'volume-78946ce2-e698-45fc-95f6-122e023ee474', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3697d1b8-341d-4de7-9f27-81605b79a39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3697d1b8-341d-4de7-9f27-81605b79a39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d551643-0167-41ea-bd15-ce73891cd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:36 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Volume 78946ce2-e698-45fc-95f6-122e023ee474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78946ce2-e698-45fc-95f6-122e023ee474', 'volume_size': 1} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=793efa88-43dc-4d12-b887-5d9d4974382a,created_at=2025-09-16T11:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-491410695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=793efa88-43dc-4d12-b887-5d9d4974382a,host='devstack@QuobyteHD#QuobyteHD',id=78946ce2-e698-45fc-95f6-122e023ee474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:36Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3003f790-a8b1-45a9-92c1-35edc3abb8cd),volume_type_id=3003f790-a8b1-45a9-92c1-35edc3abb8cd)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Creating volume 78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:16:36 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:16:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:36 devstack quobyte-client[83541]: System call of process 94749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:36 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=63, name=volume-78946ce2-e698-45fc-95f6-122e023ee474, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 1073741824" returned: 0 in 0.496s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474" returned: 0 in 0.173s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] <== create_volume: return (750ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d551643-0167-41ea-bd15-ce73891cd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78946ce2-e698-45fc-95f6-122e023ee474', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6298fc-b92a-4568-95ba-95275acfa7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Volume volume-78946ce2-e698-45fc-95f6-122e023ee474 (78946ce2-e698-45fc-95f6-122e023ee474): created successfully Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6298fc-b92a-4568-95ba-95275acfa7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (0b6e5857-85a0-4180-9e5e-4cab11095216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-dfdd7c2d-6c43-43db-bf6c-1ad6acd06fc3 tempest-GroupSnapshotsTest-1819787857 None] Created volume successfully. Sep 16 13:16:39 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (495e8e32-81a8-4f62-b229-45d64cd8cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc0541-d97e-4d67-94a5-c2237a8b3a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc0541-d97e-4d67-94a5-c2237a8b3a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894569956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=793efa88-43dc-4d12-b887-5d9d4974382a,host='devstack@QuobyteHD#QuobyteHD',id=eca12df4-136b-4d15-981d-5fc68f7cc57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:40Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3003f790-a8b1-45a9-92c1-35edc3abb8cd),volume_type_id=3003f790-a8b1-45a9-92c1-35edc3abb8cd)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6551104c-b857-4c92-b942-494849096e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6551104c-b857-4c92-b942-494849096e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494e1429-ce74-4d7c-8897-829e9e009139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494e1429-ce74-4d7c-8897-829e9e009139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca12df4-136b-4d15-981d-5fc68f7cc57f', 'volume_name': 'volume-eca12df4-136b-4d15-981d-5fc68f7cc57f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6aab7b-bd9b-434a-9511-a8df56707be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6aab7b-bd9b-434a-9511-a8df56707be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d0668-068b-4829-abc4-b2c07b70899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:39 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Volume eca12df4-136b-4d15-981d-5fc68f7cc57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca12df4-136b-4d15-981d-5fc68f7cc57f', 'volume_size': 1} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=793efa88-43dc-4d12-b887-5d9d4974382a,created_at=2025-09-16T11:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894569956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=793efa88-43dc-4d12-b887-5d9d4974382a,host='devstack@QuobyteHD#QuobyteHD',id=eca12df4-136b-4d15-981d-5fc68f7cc57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:16:40Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3003f790-a8b1-45a9-92c1-35edc3abb8cd),volume_type_id=3003f790-a8b1-45a9-92c1-35edc3abb8cd)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Creating volume eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:16:39 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:40 devstack quobyte-client[83541]: System call of process 94753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=64, name=volume-eca12df4-136b-4d15-981d-5fc68f7cc57f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f 1073741824" returned: 0 in 0.404s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f" returned: 0 in 0.137s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] <== create_volume: return (609ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676d0668-068b-4829-abc4-b2c07b70899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca12df4-136b-4d15-981d-5fc68f7cc57f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d975430-48df-44c5-b444-fdd4a0d084f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:16:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.353s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:16:41 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Volume volume-eca12df4-136b-4d15-981d-5fc68f7cc57f (eca12df4-136b-4d15-981d-5fc68f7cc57f): created successfully Sep 16 13:16:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d975430-48df-44c5-b444-fdd4a0d084f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:16:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (495e8e32-81a8-4f62-b229-45d64cd8cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:16:41 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-30dcebdc-b9f9-4459-b8dd-703a40bfbc63 tempest-GroupSnapshotsTest-1819787857 None] Created volume successfully. Sep 16 13:16:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0df01850-6f54-457f-b54e-bbcdfde9f5c3 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0df01850-6f54-457f-b54e-bbcdfde9f5c3 tempest-GroupSnapshotsTest-1819787857 None] Update group completed successfully. Sep 16 13:16:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2f696c59-a8b1-4448-864e-3f62904e0ba8 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2f696c59-a8b1-4448-864e-3f62904e0ba8 tempest-GroupSnapshotsTest-1819787857 None] Update group completed successfully. Sep 16 13:16:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5b39839a-59b1-4b4a-b2ef-61a9cc06021a tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5b39839a-59b1-4b4a-b2ef-61a9cc06021a tempest-GroupSnapshotsTest-1819787857 None] Update group completed successfully. Sep 16 13:16:45 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0e20e107-65b3-43c5-8b98-aa76707976df tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0e20e107-65b3-43c5-8b98-aa76707976df tempest-GroupSnapshotsTest-1819787857 None] Update group completed successfully. Sep 16 13:16:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] GroupSnapshot 703cf751-7a90-439d-827d-4b363c5d6383: creating. Sep 16 13:16:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Group snapshot 703cf751-7a90-439d-827d-4b363c5d6383: creating. {{(pid=83513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Creating offline snapshot 9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 of volume 78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10e7ab-eeff-4075-81d8-a4e7dffc7d2f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474" returned: 0 in 0.428s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:47 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=65, name=volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 1G" returned: 0 in 0.260s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img rebase -u -b volume-78946ce2-e698-45fc-95f6-122e023ee474 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img rebase -u -b volume-78946ce2-e698-45fc-95f6-122e023ee474 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.150s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.113s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.info" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.info" returned: 0 in 0.077s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.494s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:16:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Creating offline snapshot f5316157-d1be-4496-8de3-b702b7fdde6e of volume eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb3eba-0209-45ad-a352-fdf9a83eb2b2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f" returned: 0 in 0.567s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:49 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=67, name=volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e 1G" returned: 0 in 0.265s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eca12df4-136b-4d15-981d-5fc68f7cc57f -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:50 devstack quobyte-client[83541]: System call of process 94779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img rebase -u -b volume-eca12df4-136b-4d15-981d-5fc68f7cc57f -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.229s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.187s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.240s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.info" returned: 0 in 0.281s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:16:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.info" returned: 0 in 0.270s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:16:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-126f56ed-f20f-415c-a052-ae4314d46d59 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 703cf751-7a90-439d-827d-4b363c5d6383: created successfully Sep 16 13:16:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 703cf751-7a90-439d-827d-4b363c5d6383: deleting Sep 16 13:16:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 703cf751-7a90-439d-827d-4b363c5d6383: deleting {{(pid=83513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Deleting offline snapshot 9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 of volume 78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] snapshot_file for this snap is: volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7287caf-b4fb-4ee6-b657-86f09bff2ea9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:53 devstack quobyte-client[83541]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.764s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78946ce2-e698-45fc-95f6-122e023ee474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:16:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dd815a-d2bf-4ce3-9ed3-5f6041700c32]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:54 devstack quobyte-client[83541]: System call of process 94832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:16:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474" returned: 0 in 0.643s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.232s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474.9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-9fdb4247-5c63-4df1-9aea-69ed8c3d65d7" released by "_delete_snapshot" :: held 2.147s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" released by "delete_snapshot" :: held 2.196s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-f5316157-d1be-4496-8de3-b702b7fdde6e" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-f5316157-d1be-4496-8de3-b702b7fdde6e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Deleting offline snapshot f5316157-d1be-4496-8de3-b702b7fdde6e of volume eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] snapshot_file for this snap is: volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1408960-1146-4a35-999f-7837e87f6cd5]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.427s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca12df4-136b-4d15-981d-5fc68f7cc57f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9364f-3442-449f-a840-9e4b634755f4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f" returned: 0 in 0.481s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.243s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f.f5316157-d1be-4496-8de3-b702b7fdde6e" returned: 0 in 0.099s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-f5316157-d1be-4496-8de3-b702b7fdde6e" released by "_delete_snapshot" :: held 1.565s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" released by "delete_snapshot" :: held 1.590s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:57 devstack cinder-volume[83513]: WARNING cinder.quota [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1314476888 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1314476888, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:16:57 devstack cinder-volume[83513]: WARNING cinder.quota [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1314476888 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1314476888, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:16:57 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['4140c18b-00f2-423a-af1c-22c42d1a97ae', 'a379171c-2663-4e4d-a94f-05301792f45e', 'de705d18-8690-472d-87dd-c92aec93eceb', '812e43e3-7e1f-42bd-861c-623a29a0c698'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:57 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['e8fafbd8-64f0-41f2-ae48-14570b6768cf', 'aed6f58c-9459-48eb-8470-0562d7a58fa2', 'e7f97b10-d89a-44a2-8a91-0d108e8223b7', '176fb45c-8577-4414-b6bc-d80f377a030a'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:16:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7ceac459-d3ea-406d-8459-17e4700e57f8 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 703cf751-7a90-439d-827d-4b363c5d6383: deleted successfully Sep 16 13:16:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:16:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0a809-1377-4c6c-8c41-42ed22074f64]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474" returned: 0 in 0.489s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-78946ce2-e698-45fc-95f6-122e023ee474" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-78946ce2-e698-45fc-95f6-122e023ee474" released by "delete_volume" :: held 0.799s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" acquired by "delete_volume" :: waited 0.039s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ca1df-ea9e-4570-9f7f-e033b6df2523]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:16:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f" returned: 0 in 0.552s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-eca12df4-136b-4d15-981d-5fc68f7cc57f" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-eca12df4-136b-4d15-981d-5fc68f7cc57f" released by "delete_volume" :: held 0.866s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:00 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['a26ae2c6-f536-4800-a9a9-6ee8f479a3e3'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:01 devstack cinder-volume[83513]: WARNING cinder.quota [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1314476888 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1314476888, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['0113640d-a09f-4a4d-b111-9a91de4b6f3f', 'e260ab7a-e391-4943-9dd7-826348a82846', '364a000d-65d4-432d-8b29-f7112b59df75', 'e3a5a493-77dc-4fb4-bc60-38a6269c6167'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['53ddfb55-e6f6-4f85-8661-3a01241a66d2', 'adcb467f-32f6-4c56-91b7-c43e2df58460', '516ec875-775a-4dce-8ccc-b2dcba8b8bd6', '3132fadd-5c05-47ef-9110-e03be97e88d6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=95,cinder:UPDATE=101,cinder:INSERT=17,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.192s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:01 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ff1c2ac3-f4c9-45eb-bb29-1d68f597ee50 tempest-GroupSnapshotsTest-1819787857 None] Delete group completed successfully. Sep 16 13:17:04 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=98,cinder:UPDATE=98,cinder:DELETE=4,cinder:INSERT=26 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:17:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-76a48a96-7de9-4bdd-8c2e-f4c8b453f35e tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-76a48a96-7de9-4bdd-8c2e-f4c8b453f35e tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-404633124: creating Sep 16 13:17:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-76a48a96-7de9-4bdd-8c2e-f4c8b453f35e tempest-GroupSnapshotsTest-1819787857 None] Group tempest-GroupSnapshotsTest-Group-404633124: created successfully Sep 16 13:17:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-76a48a96-7de9-4bdd-8c2e-f4c8b453f35e tempest-GroupSnapshotsTest-1819787857 None] Create group completed successfully. Sep 16 13:17:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (fbeba36a-bc8a-453a-ad3c-5f186e03adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc130c3-4455-4845-80a6-b8884114605c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc130c3-4455-4845-80a6-b8884114605c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458129826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca189613-fbae-4575-8ff3-dfe8e6f4b9df,host='devstack@QuobyteHD#QuobyteHD',id=c9d0e5da-b8cb-4621-9e3d-5e03dd317636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:06Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86876676-44fc-477f-95d4-2c34b18ec5e4),volume_type_id=86876676-44fc-477f-95d4-2c34b18ec5e4)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa654853-c9e0-476f-b4b9-e030d80fc015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa654853-c9e0-476f-b4b9-e030d80fc015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aa59c8-c661-4c2b-80fa-4444efaf262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69aa59c8-c661-4c2b-80fa-4444efaf262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d0e5da-b8cb-4621-9e3d-5e03dd317636', 'volume_name': 'volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eb9ae2-8a47-48f0-8360-a681ce55d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eb9ae2-8a47-48f0-8360-a681ce55d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a650a95a-e019-44eb-82eb-f07fd5e5baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Volume c9d0e5da-b8cb-4621-9e3d-5e03dd317636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636', 'volume_size': 1} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca189613-fbae-4575-8ff3-dfe8e6f4b9df,created_at=2025-09-16T11:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458129826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca189613-fbae-4575-8ff3-dfe8e6f4b9df,host='devstack@QuobyteHD#QuobyteHD',id=c9d0e5da-b8cb-4621-9e3d-5e03dd317636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef02eaa185447318d71a0d03abd4678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:06Z,use_quota=True,user_id='ed3338631c8b4c7d91a3e512a6c89bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86876676-44fc-477f-95d4-2c34b18ec5e4),volume_type_id=86876676-44fc-477f-95d4-2c34b18ec5e4)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Creating volume c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:17:06 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:06 devstack quobyte-client[83541]: System call of process 94949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:06 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=69, name=volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 1073741824" returned: 0 in 0.481s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] <== create_volume: return (679ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:17:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a650a95a-e019-44eb-82eb-f07fd5e5baf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2469e-551a-443f-ba18-85ac8bf68e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:08 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Volume volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 (c9d0e5da-b8cb-4621-9e3d-5e03dd317636): created successfully Sep 16 13:17:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2469e-551a-443f-ba18-85ac8bf68e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Flow 'volume_create_manager' (fbeba36a-bc8a-453a-ad3c-5f186e03adde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:08 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6eda35bd-f31a-4a67-81f3-771cfcc1b249 tempest-GroupSnapshotsTest-1819787857 None] Created volume successfully. Sep 16 13:17:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] GroupSnapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: creating. Sep 16 13:17:09 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Group snapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: creating. {{(pid=83513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Creating offline snapshot 08ddf76d-bfc1-455b-857a-3444f5fd6574 of volume c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7ac042-1561-4d8f-9836-3705823fad6a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" returned: 0 in 0.484s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=70, name=volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 1G" returned: 0 in 0.327s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img rebase -u -b volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.165s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.127s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.info" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.info" returned: 0 in 0.093s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.731s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d1880e7e-4a78-45ba-9d7b-2cc6ddcc64c0 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: created successfully Sep 16 13:17:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: deleting Sep 16 13:17:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: deleting {{(pid=83513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" acquired by "delete_snapshot" :: waited 0.080s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-08ddf76d-bfc1-455b-857a-3444f5fd6574" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-08ddf76d-bfc1-455b-857a-3444f5fd6574" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Deleting offline snapshot 08ddf76d-bfc1-455b-857a-3444f5fd6574 of volume c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] snapshot_file for this snap is: volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63f085-58ce-4d8b-944b-e0f81939b20f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:13 devstack quobyte-client[83541]: System call of process 94972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.768s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:17:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75dd5b2-6333-4239-92db-0fdccd5f0f4c]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:14 devstack quobyte-client[83541]: System call of process 94975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" returned: 0 in 0.882s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:14 devstack quobyte-client[83541]: System call of process 94979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.232s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636.08ddf76d-bfc1-455b-857a-3444f5fd6574" returned: 0 in 0.135s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-08ddf76d-bfc1-455b-857a-3444f5fd6574" released by "_delete_snapshot" :: held 2.470s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" released by "delete_snapshot" :: held 2.498s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:15 devstack cinder-volume[83513]: WARNING cinder.quota [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-718855451 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-718855451, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:15 devstack cinder-volume[83513]: WARNING cinder.quota [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-718855451 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-718855451, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:15 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['1ccfefd4-c7b2-470b-b72b-ee5a4b775819', '9ac985b9-e981-4a42-876a-2a24a58a30cb', 'c20b13d7-f5a9-42de-bc57-20499cb5c3b3', '2b955dde-568f-4121-a304-5e52b34620f2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-656354ff-f398-4516-a789-d7680c394c81 tempest-GroupSnapshotsTest-1819787857 None] group_snapshot 70b0bc83-a1ad-47dc-a6e5-4586a0335040: deleted successfully Sep 16 13:17:16 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" acquired by "delete_volume" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:16 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[57988d38-6dcc-4db0-a888-ad13c5fafa15]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" returned: 0 in 0.438s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Lock "cinder-quobyte-c9d0e5da-b8cb-4621-9e3d-5e03dd317636" released by "delete_volume" :: held 0.718s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['e3fcdd37-6fdd-4e89-af01-e9920b87e27a'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:17 devstack cinder-volume[83513]: WARNING cinder.quota [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-718855451 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-718855451, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:17 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Created reservations ['639399f6-4c71-498b-9b73-ea3aceaf5aac', '4345f333-724c-44fc-bf49-c235241d9985', '8916987b-f8da-4a53-8d75-3314c50bf1ff', '15b69675-3ef0-4db9-bb2f-44589e165797'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:18 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:18 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bdd51e61-6889-4785-a183-9f3a37baf31e tempest-GroupSnapshotsTest-1819787857 None] Delete group completed successfully. Sep 16 13:17:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6ab04329-46e1-4d01-9764-a6a5fc4facc8 tempest-GroupSnapshotsV319Test-1095783532 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6ab04329-46e1-4d01-9764-a6a5fc4facc8 tempest-GroupSnapshotsV319Test-1095783532 None] Group tempest-GroupSnapshotsV319Test-Group-810464013: creating Sep 16 13:17:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6ab04329-46e1-4d01-9764-a6a5fc4facc8 tempest-GroupSnapshotsV319Test-1095783532 None] Group tempest-GroupSnapshotsV319Test-Group-810464013: created successfully Sep 16 13:17:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6ab04329-46e1-4d01-9764-a6a5fc4facc8 tempest-GroupSnapshotsV319Test-1095783532 None] Create group completed successfully. Sep 16 13:17:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Flow 'volume_create_manager' (39c9147b-d3b6-4783-becf-5df8ca793013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ded17b8-8f42-4743-aaf0-c01241de8dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ded17b8-8f42-4743-aaf0-c01241de8dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-317015339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc9fe7e5-16dd-4feb-85b0-33afae35c17a,host='devstack@QuobyteHD#QuobyteHD',id=136350ba-5055-451d-8c4b-9d7483ea98d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a924cd7cc04e4e10a1d383395a557bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:27Z,use_quota=True,user_id='30473d212a114b32aa410b3d8e5b759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a77db5-cb11-4dbc-b315-997267281868),volume_type_id=18a77db5-cb11-4dbc-b315-997267281868)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5926451-bfc2-4f11-8753-6578805a24b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5926451-bfc2-4f11-8753-6578805a24b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4f814-1ea1-4373-a33c-126d2aec6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4f814-1ea1-4373-a33c-126d2aec6c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136350ba-5055-451d-8c4b-9d7483ea98d4', 'volume_name': 'volume-136350ba-5055-451d-8c4b-9d7483ea98d4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077a15fd-0c10-4da0-9997-0143ddd23e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077a15fd-0c10-4da0-9997-0143ddd23e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb7e80f-4694-4710-a034-1adb9dfc751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Volume 136350ba-5055-451d-8c4b-9d7483ea98d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136350ba-5055-451d-8c4b-9d7483ea98d4', 'volume_size': 1} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cc9fe7e5-16dd-4feb-85b0-33afae35c17a,created_at=2025-09-16T11:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-317015339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cc9fe7e5-16dd-4feb-85b0-33afae35c17a,host='devstack@QuobyteHD#QuobyteHD',id=136350ba-5055-451d-8c4b-9d7483ea98d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a924cd7cc04e4e10a1d383395a557bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:27Z,use_quota=True,user_id='30473d212a114b32aa410b3d8e5b759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18a77db5-cb11-4dbc-b315-997267281868),volume_type_id=18a77db5-cb11-4dbc-b315-997267281868)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Creating volume 136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:17:27 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:27 devstack quobyte-client[83541]: System call of process 94991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:27 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=72, name=volume-136350ba-5055-451d-8c4b-9d7483ea98d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 1073741824" returned: 0 in 0.443s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:17:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb7e80f-4694-4710-a034-1adb9dfc751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136350ba-5055-451d-8c4b-9d7483ea98d4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff8ec6-16a4-4508-9094-654f2149c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:28 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Volume volume-136350ba-5055-451d-8c4b-9d7483ea98d4 (136350ba-5055-451d-8c4b-9d7483ea98d4): created successfully Sep 16 13:17:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bff8ec6-16a4-4508-9094-654f2149c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Flow 'volume_create_manager' (39c9147b-d3b6-4783-becf-5df8ca793013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:28 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-eb6c0204-4f23-4238-b9f9-ccd7f2a5c44d tempest-GroupSnapshotsV319Test-1095783532 None] Created volume successfully. Sep 16 13:17:30 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] GroupSnapshot 25e27587-07fe-4205-8f00-74c9afec2f86: creating. Sep 16 13:17:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Group snapshot 25e27587-07fe-4205-8f00-74c9afec2f86: creating. {{(pid=83513) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Creating offline snapshot 1a65893d-08de-46fd-970b-ba8bf81232f5 of volume 136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[58527d29-4d18-465f-815f-79d7ba565131]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4" returned: 0 in 0.565s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:31 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=73, name=volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 1G" returned: 0 in 0.299s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): qemu-img rebase -u -b volume-136350ba-5055-451d-8c4b-9d7483ea98d4 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "qemu-img rebase -u -b volume-136350ba-5055-451d-8c4b-9d7483ea98d4 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.227s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.120s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.116s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.info" returned: 0 in 0.120s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:17:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.info" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1ad3e077-12a3-46ce-8279-f00496dc71f8 tempest-GroupSnapshotsV319Test-1095783532 None] group_snapshot 25e27587-07fe-4205-8f00-74c9afec2f86: created successfully Sep 16 13:17:33 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] group_snapshot 25e27587-07fe-4205-8f00-74c9afec2f86: deleting Sep 16 13:17:33 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] group_snapshot 25e27587-07fe-4205-8f00-74c9afec2f86: deleting {{(pid=83513) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 13:17:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" acquired by "delete_snapshot" :: waited 0.066s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "cinder-quobyte-1a65893d-08de-46fd-970b-ba8bf81232f5" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-1a65893d-08de-46fd-970b-ba8bf81232f5" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Deleting offline snapshot 1a65893d-08de-46fd-970b-ba8bf81232f5 of volume 136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] snapshot_file for this snap is: volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d567ad-0f61-4c78-8680-aa284bf63f37]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.507s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-136350ba-5055-451d-8c4b-9d7483ea98d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858b64d-8004-4ba3-bb4c-aabc35732c3d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4" returned: 0 in 0.441s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:35 devstack quobyte-client[83541]: System call of process 95022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.223s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4.1a65893d-08de-46fd-970b-ba8bf81232f5" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-1a65893d-08de-46fd-970b-ba8bf81232f5" released by "_delete_snapshot" :: held 1.603s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" released by "delete_snapshot" :: held 1.659s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:36 devstack cinder-volume[83513]: WARNING cinder.quota [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2065805285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2065805285, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:36 devstack cinder-volume[83513]: WARNING cinder.quota [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2065805285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2065805285, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:36 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] Created reservations ['49637084-6f5a-45b9-aedf-1709d6e809ed', '527b477c-2939-4fcd-ba8b-3f55d4fcd30f', 'dd1eebdd-956d-48d3-a977-bab1432a4cea', 'e263a314-d274-4c31-8a95-2836f0495d18'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8aefb3e1-72a9-4e15-a815-b22920472374 tempest-GroupSnapshotsV319Test-1095783532 None] group_snapshot 25e27587-07fe-4205-8f00-74c9afec2f86: deleted successfully Sep 16 13:17:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" acquired by "delete_volume" :: waited 0.025s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:36 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1699e3-5d74-4e1e-80d6-101a7b717fde]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4" returned: 0 in 0.463s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-136350ba-5055-451d-8c4b-9d7483ea98d4" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "cinder-quobyte-136350ba-5055-451d-8c4b-9d7483ea98d4" released by "delete_volume" :: held 0.726s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Created reservations ['b100e9f7-e6b6-4de8-8594-1723d89d430c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:37 devstack cinder-volume[83513]: WARNING cinder.quota [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2065805285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2065805285, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:17:37 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Created reservations ['4f4bd5ec-1188-4c83-acc8-f455da348748', '7a7cc1a5-640c-472d-99a5-a38bb62a3ff5', 'b349ab17-ac2d-4a8c-8849-b6e9243988ed', 'fe06099a-26c8-4236-8e66-4b26d3c3c0c1'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:38 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bf828bf0-45c6-400d-9118-6f5c546f6f29 tempest-GroupSnapshotsV319Test-1095783532 None] Delete group completed successfully. Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.124s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Flow 'volume_create_manager' (21a436ed-07c5-4d82-a995-970c06666110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdcd46f-0e31-40de-8394-8eba71616f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdcd46f-0e31-40de-8394-8eba71616f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-631950239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c3575a3ce4ea4b58ae0d67a0cf11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:46Z,use_quota=True,user_id='399e934382714994a6eee5365fb1d2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80294c8-c92c-4e2c-8d96-4ffd8cf62c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80294c8-c92c-4e2c-8d96-4ffd8cf62c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c369ea93-69f2-41f8-a45f-f0f189b813de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c369ea93-69f2-41f8-a45f-f0f189b813de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3', 'volume_name': 'volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39340f6-47bf-4c79-89f1-47518c1009e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39340f6-47bf-4c79-89f1-47518c1009e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de9b226-22e8-41b3-a0d4-bfc5584295ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:46 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume 4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3', 'volume_size': 1} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-631950239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c3575a3ce4ea4b58ae0d67a0cf11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:46Z,use_quota=True,user_id='399e934382714994a6eee5365fb1d2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Creating volume 4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:17:46 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:17:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:47 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=75, name=volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 1073741824" returned: 0 in 0.295s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" returned: 0 in 0.073s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] <== create_volume: return (432ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.443s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de9b226-22e8-41b3-a0d4-bfc5584295ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f1a4c-f2f9-4a90-bc5e-f4ca74dedb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:47 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 (4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3): created successfully Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8f1a4c-f2f9-4a90-bc5e-f4ca74dedb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Flow 'volume_create_manager' (21a436ed-07c5-4d82-a995-970c06666110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-957f46f7-2a2c-48de-8506-f57cc08ba317 tempest-VolumeQuotasAdminTestJSON-680495431 None] Created volume successfully. Sep 16 13:17:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "cinder-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "cinder-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "cinder-quobyte-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "cinder-quobyte-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c57d9-e3cd-4feb-9e3c-c5caca2591a8]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" returned: 0 in 0.397s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "cinder-quobyte-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3" released by "delete_volume" :: held 0.623s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:49 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Created reservations ['443ba216-63ba-44c5-8937-1e95672c5b6d', '9c190574-b665-4b6e-8471-9e7be0a9ce6b', '9548e662-02d5-4655-aec9-c669ad5c53f9', '9bfc4c4f-7656-40cf-b253-602331c89158'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Deleted volume successfully. Sep 16 13:17:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ab464b8f-b6b1-4463-94b6-a1c22485ac6e tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "cinder-4d4c3083-3c9c-4f73-b8f7-4ce7d26463a3-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Flow 'volume_create_manager' (af312504-feed-4844-a264-8cbdf5eee651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f380afab-dd12-49ad-90de-8906e5e68324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f380afab-dd12-49ad-90de-8906e5e68324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-136141333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea402b4-ab94-4ead-bc69-7800db0743fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c3575a3ce4ea4b58ae0d67a0cf11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:51Z,use_quota=True,user_id='399e934382714994a6eee5365fb1d2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02f43b-eef3-4c26-9f2d-bac95a33ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02f43b-eef3-4c26-9f2d-bac95a33ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3261e69-cfbc-4a82-9241-eafee887ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3261e69-cfbc-4a82-9241-eafee887ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea402b4-ab94-4ead-bc69-7800db0743fc', 'volume_name': 'volume-0ea402b4-ab94-4ead-bc69-7800db0743fc', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f82f5e5-a396-4151-9aae-02ecaf1b2b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f82f5e5-a396-4151-9aae-02ecaf1b2b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea003218-245a-4126-b99a-8e39da387c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:51 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume 0ea402b4-ab94-4ead-bc69-7800db0743fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea402b4-ab94-4ead-bc69-7800db0743fc', 'volume_size': 1} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-136141333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea402b4-ab94-4ead-bc69-7800db0743fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0c3575a3ce4ea4b58ae0d67a0cf11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:17:51Z,use_quota=True,user_id='399e934382714994a6eee5365fb1d2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Creating volume 0ea402b4-ab94-4ead-bc69-7800db0743fc {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:17:51 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:17:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:51 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=76, name=volume-0ea402b4-ab94-4ead-bc69-7800db0743fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc 1073741824" returned: 0 in 0.438s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc" returned: 0 in 0.269s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] <== create_volume: return (822ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea003218-245a-4126-b99a-8e39da387c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea402b4-ab94-4ead-bc69-7800db0743fc', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d589843-5e30-40ac-8fc8-aed3a1494fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:17:52 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Volume volume-0ea402b4-ab94-4ead-bc69-7800db0743fc (0ea402b4-ab94-4ead-bc69-7800db0743fc): created successfully Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d589843-5e30-40ac-8fc8-aed3a1494fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:17:52 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Flow 'volume_create_manager' (af312504-feed-4844-a264-8cbdf5eee651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:17:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e89c711d-587a-4d41-85a4-ae3b82b9fe08 tempest-VolumeQuotasAdminTestJSON-680495431 None] Created volume successfully. Sep 16 13:17:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-020c2e82-ec04-4037-9372-bb1cbf6bb9d0 tempest-VolumeQuotasAdminTestJSON-1373948726 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-020c2e82-ec04-4037-9372-bb1cbf6bb9d0 tempest-VolumeQuotasAdminTestJSON-1373948726 None] Transfer volume completed successfully. Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Acquiring lock "cinder-0ea402b4-ab94-4ead-bc69-7800db0743fc-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "cinder-0ea402b4-ab94-4ead-bc69-7800db0743fc-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:55 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Acquiring lock "cinder-quobyte-0ea402b4-ab94-4ead-bc69-7800db0743fc" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "cinder-quobyte-0ea402b4-ab94-4ead-bc69-7800db0743fc" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dac79d-9210-4447-b021-e6878ae4ab33]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:17:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc" returned: 0 in 0.485s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ea402b4-ab94-4ead-bc69-7800db0743fc" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "cinder-quobyte-0ea402b4-ab94-4ead-bc69-7800db0743fc" released by "delete_volume" :: held 0.741s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:17:56 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Created reservations ['4aee9e9f-4a97-40ad-8380-c8b75ee5e024', 'caf0e246-dabb-4e3c-aac9-d7affbaba426', 'c31c35ce-3111-4574-920d-40b5abbaf082', 'a9fb8fbc-0b8d-4dca-90b4-65154a2bd6b6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:17:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Deleted volume successfully. Sep 16 13:17:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9a0c68c4-72e2-46ec-8570-2d90187138bb tempest-VolumeQuotasAdminTestJSON-326854763 None] Lock "cinder-0ea402b4-ab94-4ead-bc69-7800db0743fc-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=60,cinder:UPDATE=69,cinder:INSERT=16,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=60,cinder:UPDATE=59,cinder:DELETE=5,cinder:INSERT=10 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:18:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Flow 'volume_create_manager' (7e46ff4b-52a1-4c50-bafe-58e754f5c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ba09f1-a32b-49da-af4d-f7a2e24e8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ba09f1-a32b-49da-af4d-f7a2e24e8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-930846050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75b833-d031-4acc-857e-9e081b630d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2680fa892f6340ba9444df45f963f149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:06Z,use_quota=True,user_id='9381b3eb4b2142f7a8eb0b779bad8aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61b4296-0326-4e7d-b85b-c74108119764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61b4296-0326-4e7d-b85b-c74108119764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724f1277-2dd1-48b3-9d23-ba7de02d0d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724f1277-2dd1-48b3-9d23-ba7de02d0d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f75b833-d031-4acc-857e-9e081b630d06', 'volume_name': 'volume-9f75b833-d031-4acc-857e-9e081b630d06', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da1070-36bf-4d88-b21b-152f51688d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da1070-36bf-4d88-b21b-152f51688d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b750925e-d5ed-4812-acbc-33e718962875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Volume 9f75b833-d031-4acc-857e-9e081b630d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f75b833-d031-4acc-857e-9e081b630d06', 'volume_size': 1} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-930846050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75b833-d031-4acc-857e-9e081b630d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2680fa892f6340ba9444df45f963f149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:06Z,use_quota=True,user_id='9381b3eb4b2142f7a8eb0b779bad8aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Creating volume 9f75b833-d031-4acc-857e-9e081b630d06 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:18:06 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:18:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:06 devstack quobyte-client[83541]: System call of process 95129 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:18:06 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=77, name=volume-9f75b833-d031-4acc-857e-9e081b630d06, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06 1073741824" returned: 0 in 0.425s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06" returned: 0 in 0.087s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] <== create_volume: return (581ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.595s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b750925e-d5ed-4812-acbc-33e718962875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f75b833-d031-4acc-857e-9e081b630d06', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b53ed4-c8d2-4ae1-a046-6f75cdba68e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:07 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Volume volume-9f75b833-d031-4acc-857e-9e081b630d06 (9f75b833-d031-4acc-857e-9e081b630d06): created successfully Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b53ed4-c8d2-4ae1-a046-6f75cdba68e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Flow 'volume_create_manager' (7e46ff4b-52a1-4c50-bafe-58e754f5c5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2737eb26-1c26-482f-ade1-fab3d22d159c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Created volume successfully. Sep 16 13:18:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Acquiring lock "cinder-9f75b833-d031-4acc-857e-9e081b630d06-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "cinder-9f75b833-d031-4acc-857e-9e081b630d06-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:09 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Acquiring lock "cinder-quobyte-9f75b833-d031-4acc-857e-9e081b630d06" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "cinder-quobyte-9f75b833-d031-4acc-857e-9e081b630d06" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4656f8a-9e53-47a4-a036-9998f5c8af27]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06" returned: 0 in 0.475s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9f75b833-d031-4acc-857e-9e081b630d06" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "cinder-quobyte-9f75b833-d031-4acc-857e-9e081b630d06" released by "delete_volume" :: held 0.726s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:10 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Created reservations ['5411e554-e099-4ca9-933a-1f39627fdae4', 'da8a8946-9479-473e-8f35-38d4e908665b', '83416904-1ea8-499e-9498-3d7a8f44abc0', '65834826-1976-4357-97a3-4f1db84f37ca'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:18:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Deleted volume successfully. Sep 16 13:18:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-11d8d122-e6ff-404a-9200-85918623ff1c tempest-VolumeQuotasNegativeTestJSON-1291006150 None] Lock "cinder-9f75b833-d031-4acc-857e-9e081b630d06-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:18 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (1ec2c5fe-1d4d-4f5f-a1e2-0cb0889f9dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448c9535-2337-4aa4-9275-827ff84569ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (448c9535-2337-4aa4-9275-827ff84569ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2126968084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba34db5-890a-4405-b635-6be9ff0b30a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:18Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9210b4-e6cc-4cfa-afb8-9726597fca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9210b4-e6cc-4cfa-afb8-9726597fca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4248bf4-709a-4ea9-982c-626a0dbcaba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4248bf4-709a-4ea9-982c-626a0dbcaba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba34db5-890a-4405-b635-6be9ff0b30a4', 'volume_name': 'volume-0ba34db5-890a-4405-b635-6be9ff0b30a4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad466c45-b307-4980-99bc-a65c9e549171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad466c45-b307-4980-99bc-a65c9e549171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b399a2f6-ccd2-440d-aae0-665fa19d5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Volume 0ba34db5-890a-4405-b635-6be9ff0b30a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba34db5-890a-4405-b635-6be9ff0b30a4', 'volume_size': 1} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2126968084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba34db5-890a-4405-b635-6be9ff0b30a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:18Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Creating volume 0ba34db5-890a-4405-b635-6be9ff0b30a4 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:18:18 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:18 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=78, name=volume-0ba34db5-890a-4405-b635-6be9ff0b30a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 1073741824" returned: 0 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:18:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b399a2f6-ccd2-440d-aae0-665fa19d5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba34db5-890a-4405-b635-6be9ff0b30a4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb118e0-5cae-40b4-8b5a-18e15baeef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Volume volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 (0ba34db5-890a-4405-b635-6be9ff0b30a4): created successfully Sep 16 13:18:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb118e0-5cae-40b4-8b5a-18e15baeef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (1ec2c5fe-1d4d-4f5f-a1e2-0cb0889f9dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cd42da82-9d9f-477c-a20d-b80817dbadbd tempest-AttachVolumeNegativeTest-781168967 None] Created volume successfully. Sep 16 13:18:23 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Flow 'volume_create_manager' (ef14e5eb-090c-471b-ac3f-32fd8fba78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e43e152-0038-4350-b82b-d713ce626805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e43e152-0038-4350-b82b-d713ce626805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-647824310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeafd53cbec48d6b0dd27bd8ccb4702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:23Z,use_quota=True,user_id='4909a96254274aaaa44261955bd339f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf8953dd-54fe-47a5-b40e-5d5739dac350),volume_type_id=bf8953dd-54fe-47a5-b40e-5d5739dac350)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64161abc-59ba-4829-bdf2-6c177c8c87e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64161abc-59ba-4829-bdf2-6c177c8c87e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6927e25-049e-4d9f-92bd-833908e77835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6927e25-049e-4d9f-92bd-833908e77835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355', 'volume_name': 'volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2621b8bd-85da-4fdb-9d3f-7d5e400b23a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2621b8bd-85da-4fdb-9d3f-7d5e400b23a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b661e5fa-0984-4805-87db-536b3dc5e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:23 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Volume dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355', 'volume_size': 1} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-647824310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeafd53cbec48d6b0dd27bd8ccb4702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:23Z,use_quota=True,user_id='4909a96254274aaaa44261955bd339f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf8953dd-54fe-47a5-b40e-5d5739dac350),volume_type_id=bf8953dd-54fe-47a5-b40e-5d5739dac350)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Creating volume dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:18:23 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:23 devstack quobyte-client[83541]: System call of process 95151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:18:23 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=79, name=volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 1073741824" returned: 0 in 0.426s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" returned: 0 in 0.156s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] <== create_volume: return (653ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:18:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b661e5fa-0984-4805-87db-536b3dc5e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16655af9-ccaf-48bc-bfdf-2c62ce467cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:24 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Volume volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 (dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355): created successfully Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16655af9-ccaf-48bc-bfdf-2c62ce467cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Flow 'volume_create_manager' (ef14e5eb-090c-471b-ac3f-32fd8fba78c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-588515d4-df1a-45cf-990f-4abe39059be0 tempest-VolumeTypesAccessTest-32553177 None] Created volume successfully. Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8d654-4042-4684-b4d9-323c658b17bf]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4" returned: 0 in 0.458s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.522s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Acquiring lock "cinder-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "cinder-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-0ba34db5-890a-4405-b635-6be9ff0b30a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '559be457-30af-40a4-8922-71b5e9fc35da', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:18:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Acquiring lock "cinder-quobyte-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "cinder-quobyte-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" acquired by "delete_volume" :: waited 0.019s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d11d9c-a2e5-454e-9c4e-a1f61ada3baf]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-61a2c579-9abd-4e14-a183-5d37fd2f9c38 req-dfbcd903-7982-4c94-9f73-45b3287c5286 tempest-AttachVolumeNegativeTest-781168967 None] attachment_update completed successfully. Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" returned: 0 in 0.457s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" returned: 0 in 0.091s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "cinder-quobyte-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355" released by "delete_volume" :: held 0.720s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:26 devstack cinder-volume[83513]: WARNING cinder.quota [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-575574656 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-575574656, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:18:26 devstack cinder-volume[83513]: WARNING cinder.quota [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-575574656 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-575574656, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Created reservations ['456c0f39-685f-4d62-b5cb-a8dc237054de', '19f9b633-5601-4c20-9e29-b4f13d4f0020', '43c1abf8-2ebc-4d58-87af-aac1ce5eebf3', '0f4af948-d3e9-44ba-9b24-e06a368e33f8'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:26 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:18:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Deleted volume successfully. Sep 16 13:18:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2c4473d4-6fc6-44f8-a3e6-089ee65d86ed tempest-VolumeTypesAccessTest-32553177 None] Lock "cinder-dc7ef903-c8b2-4d9d-bb89-4e2ec80a2355-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:36 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=15,cinder:UPDATE=32,cinder:INSERT=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:18:37 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:DELETE=5,cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:18:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:49 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:18:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Flow 'volume_create_manager' (c870a6e1-010e-4119-b725-0bc3cf965e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163ffc4d-5662-445d-8b6a-25768264d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163ffc4d-5662-445d-8b6a-25768264d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1766235025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaa4968-a9b5-411a-8a04-9145ca45ecb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd87d8b22eb64e5db930e4cff7560edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:50Z,use_quota=True,user_id='6f772596695f4d2498d5fd231c083085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f4dc40-b1c8-4d2e-bb60-b146e6879e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f4dc40-b1c8-4d2e-bb60-b146e6879e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c580c484-ab61-4686-852b-787b0a591a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c580c484-ab61-4686-852b-787b0a591a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eaa4968-a9b5-411a-8a04-9145ca45ecb0', 'volume_name': 'volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5c3477-67f7-46fd-8ea6-88e69c0d05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5c3477-67f7-46fd-8ea6-88e69c0d05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff2780-befb-41e6-bc23-506dedbd4b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Volume 8eaa4968-a9b5-411a-8a04-9145ca45ecb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0', 'volume_size': 1} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1766235025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eaa4968-a9b5-411a-8a04-9145ca45ecb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd87d8b22eb64e5db930e4cff7560edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:18:50Z,use_quota=True,user_id='6f772596695f4d2498d5fd231c083085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Creating volume 8eaa4968-a9b5-411a-8a04-9145ca45ecb0 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:18:50 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:50 devstack quobyte-client[83541]: System call of process 95609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:18:50 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=80, name=volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 1073741824" returned: 0 in 0.331s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] <== create_volume: return (488ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff2780-befb-41e6-bc23-506dedbd4b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f65ca9-547f-459c-8fca-0b175ed72d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:18:50 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Volume volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 (8eaa4968-a9b5-411a-8a04-9145ca45ecb0): created successfully Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f65ca9-547f-459c-8fca-0b175ed72d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:18:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Flow 'volume_create_manager' (c870a6e1-010e-4119-b725-0bc3cf965e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:18:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-8ab8d55f-4ee9-4bd6-8489-13f5aaaaa27a tempest-AbsoluteLimitsTests-1969072012 None] Created volume successfully. Sep 16 13:18:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Acquiring lock "cinder-8eaa4968-a9b5-411a-8a04-9145ca45ecb0-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "cinder-8eaa4968-a9b5-411a-8a04-9145ca45ecb0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Acquiring lock "cinder-quobyte-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "cinder-quobyte-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1461a4-3f0a-41ae-a5a8-848339fbb8b2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" returned: 0 in 0.487s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" returned: 0 in 0.091s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "cinder-quobyte-8eaa4968-a9b5-411a-8a04-9145ca45ecb0" released by "delete_volume" :: held 0.754s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Created reservations ['d1ed42e7-08da-49e9-b48b-bd50c9a02389', '23da2651-0d40-4862-b0c7-6d59506b4759', 'e1217ab7-c20f-4009-b31a-9570a03b4c52', 'ecdb81fb-3561-4dcc-a9b9-7e2b575f6ece'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:18:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.218s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:18:54 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:18:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Deleted volume successfully. Sep 16 13:18:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e990dabb-57f4-431d-ac87-c35a3fde567e tempest-AbsoluteLimitsTests-1969072012 None] Lock "cinder-8eaa4968-a9b5-411a-8a04-9145ca45ecb0-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:19:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Flow 'volume_create_manager' (e55530fb-be3d-4827-89bb-cbebc1357bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17196005-0dc3-4fb1-bb39-8d9de9547be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17196005-0dc3-4fb1-bb39-8d9de9547be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1159966041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d13c53-31d4-4d5f-b5a0-36f87819c06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e037b418e0d0465c87a916333bc56cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:02Z,use_quota=True,user_id='2676029cea124df28c363730c146f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482883ca-c6e0-460c-849d-f9284d2d9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482883ca-c6e0-460c-849d-f9284d2d9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c64c7c4-997d-46b2-b406-371fc85613e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c64c7c4-997d-46b2-b406-371fc85613e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d13c53-31d4-4d5f-b5a0-36f87819c06f', 'volume_name': 'volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4a4b8a-86ac-4b8e-a520-0b4680ccc3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4a4b8a-86ac-4b8e-a520-0b4680ccc3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4be51bf-0359-4ff4-ba99-857e568bf23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Volume 72d13c53-31d4-4d5f-b5a0-36f87819c06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f', 'volume_size': 1} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1159966041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d13c53-31d4-4d5f-b5a0-36f87819c06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e037b418e0d0465c87a916333bc56cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:02Z,use_quota=True,user_id='2676029cea124df28c363730c146f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Creating volume 72d13c53-31d4-4d5f-b5a0-36f87819c06f {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:19:02 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:02 devstack quobyte-client[83541]: System call of process 95702 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:19:02 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=81, name=volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f 1073741824" returned: 0 in 0.448s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f" returned: 0 in 0.197s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] <== create_volume: return (741ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:19:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4be51bf-0359-4ff4-ba99-857e568bf23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38f6b61-561a-42f3-993b-65e40f011d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:03 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Volume volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f (72d13c53-31d4-4d5f-b5a0-36f87819c06f): created successfully Sep 16 13:19:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38f6b61-561a-42f3-993b-65e40f011d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Flow 'volume_create_manager' (e55530fb-be3d-4827-89bb-cbebc1357bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5dc24561-0700-47c7-9250-71fd07480442 tempest-VolumesTransfersV357Test-968889686 None] Created volume successfully. Sep 16 13:19:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-873cfdeb-2748-4feb-a331-876117f53529 tempest-VolumesTransfersV357Test-1879006154 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-873cfdeb-2748-4feb-a331-876117f53529 tempest-VolumesTransfersV357Test-1879006154 None] Transfer volume completed successfully. Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "cinder-72d13c53-31d4-4d5f-b5a0-36f87819c06f-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-72d13c53-31d4-4d5f-b5a0-36f87819c06f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:19:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "cinder-quobyte-72d13c53-31d4-4d5f-b5a0-36f87819c06f" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-quobyte-72d13c53-31d4-4d5f-b5a0-36f87819c06f" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cb99a7-b4d2-45bb-8564-301e042b51c3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f" returned: 0 in 0.490s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-72d13c53-31d4-4d5f-b5a0-36f87819c06f" returned: 0 in 0.092s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-quobyte-72d13c53-31d4-4d5f-b5a0-36f87819c06f" released by "delete_volume" :: held 0.766s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Created reservations ['200eacb5-b1aa-4d39-8118-acd9583bc3a7', '88351a89-6b88-4098-9614-576a930219df', '67f257fb-ab99-4c43-94a7-2eaf615360e7', '620ac8f3-a9fd-418d-8d6c-4bd95b305d97'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.099s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:19:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Deleted volume successfully. Sep 16 13:19:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2a682a81-8dee-450d-bce0-ef548c5e80f7 tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-72d13c53-31d4-4d5f-b5a0-36f87819c06f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:19:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:08 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Flow 'volume_create_manager' (9fef8d71-253e-416f-9b52-6c40b57ee309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6918fe7f-ca00-4ff4-bed1-5df6431608f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6918fe7f-ca00-4ff4-bed1-5df6431608f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1918232933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0a7be6-76a4-48c6-8079-7da69f1fca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e037b418e0d0465c87a916333bc56cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:09Z,use_quota=True,user_id='2676029cea124df28c363730c146f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd46a79-534d-44bb-8265-f06c01842dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd46a79-534d-44bb-8265-f06c01842dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a184b0b8-f8da-4459-9342-40e74f88bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a184b0b8-f8da-4459-9342-40e74f88bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0a7be6-76a4-48c6-8079-7da69f1fca48', 'volume_name': 'volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eaecfe-6f06-403c-930e-a61cb59b3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6eaecfe-6f06-403c-930e-a61cb59b3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0a5dc-d18a-4fce-920a-414fd39daf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Volume fc0a7be6-76a4-48c6-8079-7da69f1fca48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48', 'volume_size': 1} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1918232933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0a7be6-76a4-48c6-8079-7da69f1fca48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e037b418e0d0465c87a916333bc56cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:09Z,use_quota=True,user_id='2676029cea124df28c363730c146f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Creating volume fc0a7be6-76a4-48c6-8079-7da69f1fca48 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:19:09 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:09 devstack quobyte-client[83541]: System call of process 95720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:19:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=82, name=volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 1073741824" returned: 0 in 0.351s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48" returned: 0 in 0.084s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] <== create_volume: return (502ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.515s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0a5dc-d18a-4fce-920a-414fd39daf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2fedc-9ddb-46f7-9382-51a52e7f5ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Volume volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 (fc0a7be6-76a4-48c6-8079-7da69f1fca48): created successfully Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2fedc-9ddb-46f7-9382-51a52e7f5ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Flow 'volume_create_manager' (9fef8d71-253e-416f-9b52-6c40b57ee309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ffbc7a14-bd1f-46ce-961a-10abe97fb53f tempest-VolumesTransfersV357Test-968889686 None] Created volume successfully. Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "cinder-fc0a7be6-76a4-48c6-8079-7da69f1fca48-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-fc0a7be6-76a4-48c6-8079-7da69f1fca48-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:19:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "cinder-quobyte-fc0a7be6-76a4-48c6-8079-7da69f1fca48" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-quobyte-fc0a7be6-76a4-48c6-8079-7da69f1fca48" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e34382-c658-4bc8-a176-152a3a12d5f6]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:19:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48" returned: 0 in 0.459s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-fc0a7be6-76a4-48c6-8079-7da69f1fca48" returned: 0 in 0.095s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-quobyte-fc0a7be6-76a4-48c6-8079-7da69f1fca48" released by "delete_volume" :: held 0.722s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Created reservations ['d61d327a-4e20-45df-a700-76f3f209adbb', '9f40c7e8-54fb-4c3e-9e00-4835ea4c6d94', 'b99ad69b-a8cf-4952-8a76-29f36272b9a1', '244541e6-05b4-4be7-b6a6-a6b994b56685'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:12 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:19:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Deleted volume successfully. Sep 16 13:19:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-74ee07fc-dbff-4aa0-8128-3000a075749b tempest-VolumesTransfersV357Test-1191101990 None] Lock "cinder-fc0a7be6-76a4-48c6-8079-7da69f1fca48-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:19:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=5 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:19:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=35,cinder:DELETE=1,cinder:SELECT=17,cinder:INSERT=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:19:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Flow 'volume_create_manager' (c8591e9b-45d9-456b-ad39-f63b8243aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcd1f5d-4175-4148-872f-22c34c057503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcd1f5d-4175-4148-872f-22c34c057503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-366205782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c463a0-fa7a-4d84-bb6b-012d4e13223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e798e330bd44eeb9ac0793dead730c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:34Z,use_quota=True,user_id='59eb185e2b3f4820a84384c59a47c95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69b944b-4be6-4c54-bc45-4fe4ecdd2d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69b944b-4be6-4c54-bc45-4fe4ecdd2d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ec802-628a-40f2-8818-f0651248709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ec802-628a-40f2-8818-f0651248709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c463a0-fa7a-4d84-bb6b-012d4e13223e', 'volume_name': 'volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054298f8-dd9a-4042-862a-c6dc405c79a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054298f8-dd9a-4042-862a-c6dc405c79a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c88166-344a-453f-bf64-4e195a54562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e', 'volume_size': 1} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-366205782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c463a0-fa7a-4d84-bb6b-012d4e13223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e798e330bd44eeb9ac0793dead730c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:19:34Z,use_quota=True,user_id='59eb185e2b3f4820a84384c59a47c95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Creating volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:19:34 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:19:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:34 devstack quobyte-client[83541]: System call of process 95776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:19:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=83, name=volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e 1073741824" returned: 0 in 0.438s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.086s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] <== create_volume: return (609ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c88166-344a-453f-bf64-4e195a54562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ce92cc-42f7-4e12-a856-54e15cda295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:19:35 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Volume volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e (e1c463a0-fa7a-4d84-bb6b-012d4e13223e): created successfully Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ce92cc-42f7-4e12-a856-54e15cda295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:19:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Flow 'volume_create_manager' (c8591e9b-45d9-456b-ad39-f63b8243aece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:19:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-92ec35a5-12ea-467d-b61c-2ba7b11921cf tempest-VolumesActionsTest-1563400114 None] Created volume successfully. Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.084s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:19:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:19:45 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:19:45 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:20:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" by "attach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:20:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" acquired by "attach_volume" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:20:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Attaching volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e to instance c4734601-914c-4ecb-9cb2-776eefa1181d at mountpoint /dev/vdb on host None. Sep 16 13:20:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Attach volume completed successfully. Sep 16 13:20:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-66ecedd4-b9bc-4fff-b43e-570a930ebeb4 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" released by "attach_volume" :: held 0.355s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:20:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" by "detach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:20:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:20:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Detaching volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e from instance c4734601-914c-4ecb-9cb2-776eefa1181d. Sep 16 13:20:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Detach volume completed successfully. Sep 16 13:20:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-1fbdddcb-1de5-4920-ad07-c5ba4c8e2da6 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:20:13 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:20:13 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" by "attach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" acquired by "attach_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:20:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Attaching volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e to instance fef46630-b0c4-4212-85ac-4dd023a9e6e2 at mountpoint /dev/vdb on host None. Sep 16 13:20:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Attach volume completed successfully. Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f90bf164-ba55-4074-a9a8-43d59f55fd33 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" released by "attach_volume" :: held 0.147s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" by "detach_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:20:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Detaching volume e1c463a0-fa7a-4d84-bb6b-012d4e13223e from instance fef46630-b0c4-4212-85ac-4dd023a9e6e2. Sep 16 13:20:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Detach volume completed successfully. Sep 16 13:20:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-917db8f5-5d99-4c21-b00f-bf6bf4fcbd5e tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:20:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:20:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.187s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:20:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:20:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-21771563-8449-4112-bde6-0fb7a924ebd3 req-a1011681-490c-43ee-b058-c4d6b0d6436a tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-21771563-8449-4112-bde6-0fb7a924ebd3 req-a1011681-490c-43ee-b058-c4d6b0d6436a tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-21771563-8449-4112-bde6-0fb7a924ebd3 req-a1011681-490c-43ee-b058-c4d6b0d6436a tempest-AttachVolumeNegativeTest-781168967 None] Terminate volume connection completed successfully. Sep 16 13:20:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-21771563-8449-4112-bde6-0fb7a924ebd3 req-a1011681-490c-43ee-b058-c4d6b0d6436a tempest-AttachVolumeNegativeTest-781168967 None] Deleting attachment 559be457-30af-40a4-8922-71b5e9fc35da. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:20:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:20:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:20:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:20:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666c5cb-4b2a-457c-8ec0-c96590204a30]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:20:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:20:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.503s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:20:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a15ac-7024-445b-96fa-fcf3411d96c3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:20:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:20:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.422s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:20:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.991e2a4e-55b9-427c-9362-b6db8f233fcduzn_9e79.img {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:20:52 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:20:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.991e2a4e-55b9-427c-9362-b6db8f233fcduzn_9e79.img" returned: 0 in 5.959s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:20:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f33215-863b-439f-9c66-ebd8e952de19]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:20:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:20:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.880s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:20:57 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.991e2a4e-55b9-427c-9362-b6db8f233fcduzn_9e79.img {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:20:57 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Converted 1024.00 MB image at 171.61 MB/s Sep 16 13:20:58 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] 991e2a4e-55b9-427c-9362-b6db8f233fcd was raw, no need to convert to raw {{(pid=83513) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 16 13:21:08 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:21:08 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:21:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:21:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:21:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.171s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:21:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 57.449s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:21:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Uploaded volume to glance image-id: 991e2a4e-55b9-427c-9362-b6db8f233fcd. {{(pid=83513) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 13:21:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3df687c5-0ec4-4f50-8309-a9550f714732 tempest-VolumesActionsTest-1563400114 None] Copy volume to image completed successfully. Sep 16 13:21:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:21:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:21:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:21:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc4d82-d71f-4a5f-b6b4-6534d2ab967c]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:21:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.496s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d30ee4-cadc-4d84-9e3b-1a52ba71f643]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:21:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:50 devstack quobyte-client[83541]: System call of process 96449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:21:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.471s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:50 devstack quobyte-client[83541]: System call of process 96452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:21:57 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:21:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img" returned: 0 in 6.667s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:57 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2add1-6db3-4758-a6c4-23b52a3b73a8]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:21:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:58 devstack quobyte-client[83541]: System call of process 96465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:21:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.813s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:58 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:21:58 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Converted 1024.00 MB image at 153.40 MB/s Sep 16 13:21:58 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5 was raw, converting to qcow2 {{(pid=83513) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 16 13:21:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[265bc179-176d-4b57-a755-941f264da93d]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:21:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:21:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img" returned: 0 in 1.075s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:21:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img" returned: 1 in 0.457s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img /opt/stack/data/cinder/conversion/vol_upload_myw1c1ky {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img /opt/stack/data/cinder/conversion/vol_upload_myw1c1ky" returned: 0 in 0.156s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Image conversion details: src /opt/stack/data/cinder/conversion/e1c463a0-fa7a-4d84-bb6b-012d4e13223e.temp_image.c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5x4dvzq4j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_myw1c1ky {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:22:00 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912b0cd-acfc-45ef-a1df-50180775e5ba]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_myw1c1ky {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_myw1c1ky" returned: 0 in 0.366s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.423s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Uploaded volume to glance image-id: c7fb1fd4-8d77-4241-b3f7-5fd662b7aec5. {{(pid=83513) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 13:22:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f24fc8b2-8c16-4d8a-994e-d7671de75bd2 tempest-VolumesActionsTest-1563400114 None] Copy volume to image completed successfully. Sep 16 13:22:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "cinder-quobyte-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-quobyte-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0089e71-dd0c-4c78-a9b1-49e0e4fd1bc0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.429s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" returned: 0 in 0.095s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-quobyte-e1c463a0-fa7a-4d84-bb6b-012d4e13223e" released by "delete_volume" :: held 0.682s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:04 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Created reservations ['c61708c1-72b8-4fe9-a583-98812dce7777', '36f8b99a-10e9-4431-ab01-aed747310343', '1f708b9d-bd6e-4f52-a6fa-6994cb7683ae', '8bf2590f-3d4c-432d-9e99-e16459eeb285'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.082s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:22:05 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Deleted volume successfully. Sep 16 13:22:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79efaa1c-3b8d-4725-aa27-c33db9a74547 tempest-VolumesActionsTest-1563400114 None] Lock "cinder-e1c463a0-fa7a-4d84-bb6b-012d4e13223e-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:15 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=14,cinder:SELECT=6,cinder:INSERT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:22:15 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:22:18 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Flow 'volume_create_manager' (28b300ee-4697-49fb-b69d-167710841ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c274b70a-48b9-4ac9-ad63-7a5aea80ecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c274b70a-48b9-4ac9-ad63-7a5aea80ecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1893431047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d87a62-dc18-4f71-a086-70095d6bff2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042ba6187c30474b84dabdc41b1d8ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:18Z,use_quota=True,user_id='7ede1101858745589a756c466ba46574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a7b882-32e2-4b17-abc1-8b20709670bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a7b882-32e2-4b17-abc1-8b20709670bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f944c2a7-4f37-4960-8060-abf733fb93f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f944c2a7-4f37-4960-8060-abf733fb93f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d87a62-dc18-4f71-a086-70095d6bff2d', 'volume_name': 'volume-43d87a62-dc18-4f71-a086-70095d6bff2d', 'volume_size': 2}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b802c5-9b49-4703-bab5-10665c459f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b802c5-9b49-4703-bab5-10665c459f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7642e66-cef9-4671-bab1-900bfe9e95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume 43d87a62-dc18-4f71-a086-70095d6bff2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d87a62-dc18-4f71-a086-70095d6bff2d', 'volume_size': 2} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1893431047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d87a62-dc18-4f71-a086-70095d6bff2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042ba6187c30474b84dabdc41b1d8ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:18Z,use_quota=True,user_id='7ede1101858745589a756c466ba46574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Creating volume 43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:22:18 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:22:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d 2147483648 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:18 devstack quobyte-client[83541]: System call of process 96573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:18 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=84, name=volume-43d87a62-dc18-4f71-a086-70095d6bff2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d 2147483648" returned: 0 in 0.474s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7642e66-cef9-4671-bab1-900bfe9e95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d87a62-dc18-4f71-a086-70095d6bff2d', 'volume_size': 2}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4552cb5-2178-4ce4-b17c-bd703befe0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume volume-43d87a62-dc18-4f71-a086-70095d6bff2d (43d87a62-dc18-4f71-a086-70095d6bff2d): created successfully Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4552cb5-2178-4ce4-b17c-bd703befe0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Flow 'volume_create_manager' (28b300ee-4697-49fb-b69d-167710841ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-08edc532-dbfa-4822-8b56-4f174e98e9bf tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Created volume successfully. Sep 16 13:22:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Creating offline snapshot dea9504e-5a43-4bf2-a2e0-98bf302e4536 of volume 43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:22:20 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb880ee-f063-45f5-b9a3-8c5c1e97cc9a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:21 devstack quobyte-client[83541]: System call of process 96578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d" returned: 0 in 0.477s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 2G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:21 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=85, name=volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 2G" returned: 0 in 0.266s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): qemu-img rebase -u -b volume-43d87a62-dc18-4f71-a086-70095d6bff2d -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:21 devstack quobyte-client[83541]: System call of process 96585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "qemu-img rebase -u -b volume-43d87a62-dc18-4f71-a086-70095d6bff2d -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.156s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:22:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.info" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.info" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.631s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-80f99ed8-39db-4501-85be-ae236f77aafc tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Create snapshot completed successfully Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "cinder-dea9504e-5a43-4bf2-a2e0-98bf302e4536-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-dea9504e-5a43-4bf2-a2e0-98bf302e4536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:23 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "cinder-quobyte-dea9504e-5a43-4bf2-a2e0-98bf302e4536" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-dea9504e-5a43-4bf2-a2e0-98bf302e4536" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Deleting offline snapshot dea9504e-5a43-4bf2-a2e0-98bf302e4536 of volume 43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] snapshot_file for this snap is: volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c323989d-709e-49b3-b041-17405c30f7a9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.419s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43d87a62-dc18-4f71-a086-70095d6bff2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a450a-e2bd-495c-97d9-e6be4882f053]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d" returned: 0 in 0.446s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:24 devstack quobyte-client[83541]: System call of process 96605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.231s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d.dea9504e-5a43-4bf2-a2e0-98bf302e4536" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-dea9504e-5a43-4bf2-a2e0-98bf302e4536" released by "_delete_snapshot" :: held 1.476s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" released by "delete_snapshot" :: held 1.501s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:24 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Created reservations ['88cef114-bd3d-4a73-9d8c-f23819b03cd1', '5d736256-78f2-4161-adbc-8288df6eb01e', '103ece5a-3324-42a1-99d2-a637f9150967', 'b6b0f931-95ea-4885-afb1-0ede50e8c601'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:22:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Delete snapshot completed successfully. Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3b7cb112-5b2e-4468-b0a1-64db781f684e tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-dea9504e-5a43-4bf2-a2e0-98bf302e4536-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "cinder-43d87a62-dc18-4f71-a086-70095d6bff2d-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-43d87a62-dc18-4f71-a086-70095d6bff2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f2da4-b3a8-4bfb-9704-a1045342c599]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d" returned: 0 in 0.433s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-43d87a62-dc18-4f71-a086-70095d6bff2d" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-quobyte-43d87a62-dc18-4f71-a086-70095d6bff2d" released by "delete_volume" :: held 0.698s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Created reservations ['ac2033cb-88e2-46d3-b810-bd1c9a8379fb', 'a69b774e-cf52-414c-ab9a-5656c0886281', 'b426d045-b9e9-4658-ac86-7c7667b6f05e', 'cd521f5d-80c1-40cc-a8da-17106b35b1b2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:26 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:22:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Deleted volume successfully. Sep 16 13:22:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b5b8a595-6dea-463f-ba6a-24aeda11aa20 tempest-VolumesSnapshotNegativeTestJSON-597572333 None] Lock "cinder-43d87a62-dc18-4f71-a086-70095d6bff2d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:22:36 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=18,cinder:DELETE=1,cinder:SELECT=14,cinder:INSERT=8 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:22:36 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.128s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:22:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (31d9945a-55e1-4c07-a861-363cee341501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e955aa72-014e-4855-b40c-19053cb24537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e955aa72-014e-4855-b40c-19053cb24537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767278387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b6bffa-e95c-451b-b695-a6855712ce89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:42Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f694e3e5-203b-4af5-ad37-36fe8523c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f694e3e5-203b-4af5-ad37-36fe8523c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3f2cd2-3380-426b-a0ac-0116d9971d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3f2cd2-3380-426b-a0ac-0116d9971d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b6bffa-e95c-451b-b695-a6855712ce89', 'volume_name': 'volume-e0b6bffa-e95c-451b-b695-a6855712ce89', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f2b55-273a-4eb8-a494-17ce214f4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003f2b55-273a-4eb8-a494-17ce214f4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7570b2d5-1f89-45fb-b23f-df51a1f7e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:42 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Volume e0b6bffa-e95c-451b-b695-a6855712ce89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b6bffa-e95c-451b-b695-a6855712ce89', 'volume_size': 1} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767278387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b6bffa-e95c-451b-b695-a6855712ce89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:42Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Creating volume e0b6bffa-e95c-451b-b695-a6855712ce89 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:22:42 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:22:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:42 devstack quobyte-client[83541]: System call of process 96635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:42 devstack quobyte-client[83541]: System call of process 96635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:42 devstack quobyte-client[83541]: System call of process 96635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:42 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=87, name=volume-e0b6bffa-e95c-451b-b695-a6855712ce89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 1073741824" returned: 0 in 0.323s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89" returned: 0 in 0.100s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] <== create_volume: return (497ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.512s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7570b2d5-1f89-45fb-b23f-df51a1f7e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b6bffa-e95c-451b-b695-a6855712ce89', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cb7bf8-c3e5-47e3-a7ba-1f18bde81a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Volume volume-e0b6bffa-e95c-451b-b695-a6855712ce89 (e0b6bffa-e95c-451b-b695-a6855712ce89): created successfully Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cb7bf8-c3e5-47e3-a7ba-1f18bde81a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (31d9945a-55e1-4c07-a861-363cee341501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-406fc4b8-7ed5-41bf-97e6-d6013074caea tempest-AttachVolumeNegativeTest-781168967 None] Created volume successfully. Sep 16 13:22:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:48 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed19e96-f4ad-47e0-80b8-f3df402efa5f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:22:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89" returned: 0 in 0.576s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.635s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-e0b6bffa-e95c-451b-b695-a6855712ce89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a831aa5-847d-4452-95ac-d6e6cdb55ddd', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:22:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-6a205c53-8f87-432b-b05c-95beae6ce97f req-f19da5ba-9b9f-49e2-863b-037ef4ac10b1 tempest-AttachVolumeNegativeTest-781168967 None] attachment_update completed successfully. Sep 16 13:22:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (7bef91cb-2e65-48ba-b4e8-43165da3824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132e62f-fcf1-457a-8c07-8a18e5886008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132e62f-fcf1-457a-8c07-8a18e5886008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339797666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712f30c-44d6-4f79-97f6-863ac2ca4bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:57Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132ed4a4-3ff4-4086-ad30-d2a7d5def221),volume_type_id=132ed4a4-3ff4-4086-ad30-d2a7d5def221)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda2c8b-38a0-4302-9183-063756b40b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda2c8b-38a0-4302-9183-063756b40b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b96b60-1f01-4787-aa31-c330f959414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b96b60-1f01-4787-aa31-c330f959414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2712f30c-44d6-4f79-97f6-863ac2ca4bd3', 'volume_name': 'volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad3293a-d9b5-4983-aae5-7064707f5dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad3293a-d9b5-4983-aae5-7064707f5dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe9f0c-dec4-480c-9aff-7869233f00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:56 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume 2712f30c-44d6-4f79-97f6-863ac2ca4bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3', 'volume_size': 1} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1339797666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2712f30c-44d6-4f79-97f6-863ac2ca4bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:57Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132ed4a4-3ff4-4086-ad30-d2a7d5def221),volume_type_id=132ed4a4-3ff4-4086-ad30-d2a7d5def221)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Creating volume 2712f30c-44d6-4f79-97f6-863ac2ca4bd3 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:22:56 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:22:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:57 devstack quobyte-client[83541]: System call of process 97039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:22:57 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=88, name=volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:22:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 1073741824" returned: 0 in 0.614s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:57 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:22:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (f65f3c3c-167f-4fa6-8db8-aff82fee8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87c3feb-f445-4e76-8ac5-c63028ee691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" returned: 0 in 0.724s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] <== create_volume: return (1377ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87c3feb-f445-4e76-8ac5-c63028ee691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-220313579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743d0da-7205-44e1-8395-7e4b5bab38f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:57Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be5a6b06-bda3-40e8-9344-51aebaf88f9e),volume_type_id=be5a6b06-bda3-40e8-9344-51aebaf88f9e)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22754a30-b118-4b18-a746-0b094e3a5dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22754a30-b118-4b18-a746-0b094e3a5dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34e2a3c-9920-4b98-bd63-6fc7b882dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34e2a3c-9920-4b98-bd63-6fc7b882dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f743d0da-7205-44e1-8395-7e4b5bab38f2', 'volume_name': 'volume-f743d0da-7205-44e1-8395-7e4b5bab38f2', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f64b59e-49ae-429f-8c43-cd2ab8c4aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f64b59e-49ae-429f-8c43-cd2ab8c4aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549d2ebb-f979-4f16-a84d-0ab8bcb0405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume f743d0da-7205-44e1-8395-7e4b5bab38f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f743d0da-7205-44e1-8395-7e4b5bab38f2', 'volume_size': 1} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-220313579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743d0da-7205-44e1-8395-7e4b5bab38f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:57Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be5a6b06-bda3-40e8-9344-51aebaf88f9e),volume_type_id=be5a6b06-bda3-40e8-9344-51aebaf88f9e)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Creating volume f743d0da-7205-44e1-8395-7e4b5bab38f2 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:22:58 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:58 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=89, name=volume-f743d0da-7205-44e1-8395-7e4b5bab38f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe9f0c-dec4-480c-9aff-7869233f00a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4823a794-17f7-4afe-8c65-db574837c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (f83938c0-685e-4611-b85b-f6a98bbccc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1bb391-0886-464a-ad19-a0536602286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 1073741824" returned: 0 in 0.494s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1bb391-0886-464a-ad19-a0536602286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2089321041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc0d79-97ef-449a-99d1-19b08a4a8b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:58Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c210cc21-2a44-412c-9cc5-e53e5b30ccc9),volume_type_id=c210cc21-2a44-412c-9cc5-e53e5b30ccc9)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84cd703-4fc1-465f-aab8-eb750a959336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84cd703-4fc1-465f-aab8-eb750a959336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa140d1-eefa-4211-b843-6a836e82c0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:22:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 (2712f30c-44d6-4f79-97f6-863ac2ca4bd3): created successfully Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4823a794-17f7-4afe-8c65-db574837c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (7bef91cb-2e65-48ba-b4e8-43165da3824b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2" returned: 0 in 0.502s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] <== create_volume: return (1013ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:22:59 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-749a97fc-e26f-4221-bf1d-a692131d740b tempest-TestInstancesWithCinderVolumes-1775964317 None] Created volume successfully. Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549d2ebb-f979-4f16-a84d-0ab8bcb0405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f743d0da-7205-44e1-8395-7e4b5bab38f2', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2309129c-b376-4e97-9865-cf09ea07b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 (f743d0da-7205-44e1-8395-7e4b5bab38f2): created successfully Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2309129c-b376-4e97-9865-cf09ea07b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (f65f3c3c-167f-4fa6-8db8-aff82fee8643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:22:59 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-311d6313-ac3a-4b0b-8678-811065bff377 tempest-TestInstancesWithCinderVolumes-1775964317 None] Created volume successfully. Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa140d1-eefa-4211-b843-6a836e82c0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0efc0d79-97ef-449a-99d1-19b08a4a8b77', 'volume_name': 'volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77', 'volume_size': 1, 'image_id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1400456227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc62e6177a7f41499fd2bd50c2f07bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'created_at': datetime.datetime(2025, 9, 16, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a883922a-5bc3-4beb-9856-da7749f11481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a883922a-5bc3-4beb-9856-da7749f11481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d99cfd-79ea-49c6-a471-46a4fb41a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:22:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77', 'volume_size': 1, 'image_id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1400456227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc62e6177a7f41499fd2bd50c2f07bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'created_at': datetime.datetime(2025, 9, 16, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e/file', 'properties': {}}, 'image_service': } Sep 16 13:22:59 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Cloning 0efc0d79-97ef-449a-99d1-19b08a4a8b77 from image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e at location (None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:23:01 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD, size 20.69 MB, duration 1.72 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:23:01 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Image download 20.69 MB at 12.01 MB/s Sep 16 13:23:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4081fb3-fc7c-4d5b-814b-ad6fb3d6bf33]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:01 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD Sep 16 13:23:01 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:23:03 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 16 13:23:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD" returned: 0 in 1.974s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:03 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Temporary image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e is fetched for user 4d4ad33d3f384d10ac18d8e920c0110d. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:23:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1eddc4-dba7-4357-870b-be33e9c2fe08]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:04 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD Sep 16 13:23:04 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:23:05 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD" returned: 0 in 1.982s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2089321041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efc0d79-97ef-449a-99d1-19b08a4a8b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc62e6177a7f41499fd2bd50c2f07bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:22:58Z,use_quota=True,user_id='4d4ad33d3f384d10ac18d8e920c0110d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c210cc21-2a44-412c-9cc5-e53e5b30ccc9),volume_type_id=c210cc21-2a44-412c-9cc5-e53e5b30ccc9)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Creating volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:23:05 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:23:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:05 devstack quobyte-client[83541]: System call of process 97107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:23:05 devstack quobyte-client[83541]: System call of process 97107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:23:05 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=90, name=volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 1073741824" returned: 0 in 0.276s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.078s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] <== create_volume: return (442ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.474s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Attempting download of 11a9b6c4-dad3-4941-a74c-37d9bc4e078e ((None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}])) to volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ab9a16-5b6e-4149-806a-2f23c3a0f33f]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_xvzgs6ru {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_xvzgs6ru" returned: 0 in 0.335s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_xvzgs6ru {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_xvzgs6ru" returned: 1 in 0.350s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_xvzgs6ru' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab176d-b985-4e3b-a1da-5cb39f09b33f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] 11a9b6c4-dad3-4941-a74c-37d9bc4e078e was qcow2, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:23:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:07 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=90, name=volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:23:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.872s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:08 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11a9b6c4-dad3-4941-a74c-37d9bc4e078e_dds1g4nxdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:23:08 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Converted 112.00 MB image at 112.00 MB/s Sep 16 13:23:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 1G" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7a1801-6f62-49e6-9c7b-4941c971e12f]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.350s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 1 in 0.362s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Downloaded image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e ((None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}])) to volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Temporary image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e for user 4d4ad33d3f384d10ac18d8e920c0110d is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Marking volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Copying metadata from image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e to 0efc0d79-97ef-449a-99d1-19b08a4a8b77. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:23:09 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Creating volume glance metadata for volume 0efc0d79-97ef-449a-99d1-19b08a4a8b77 backed by image 11a9b6c4-dad3-4941-a74c-37d9bc4e078e with: {'image_id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'image_name': 'tempest-scenario-img--1400456227', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:23:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d99cfd-79ea-49c6-a471-46a4fb41a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77', 'volume_size': 1, 'image_id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1400456227', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc62e6177a7f41499fd2bd50c2f07bf0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11a9b6c4-dad3-4941-a74c-37d9bc4e078e', 'created_at': datetime.datetime(2025, 9, 16, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 22, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11a9b6c4-dad3-4941-a74c-37d9bc4e078e/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:23:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b5136b-bd85-4b53-9dc9-17243c23303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:23:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 (0efc0d79-97ef-449a-99d1-19b08a4a8b77): created successfully Sep 16 13:23:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b5136b-bd85-4b53-9dc9-17243c23303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:23:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Flow 'volume_create_manager' (f83938c0-685e-4611-b85b-f6a98bbccc8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:23:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6ac05cb6-d085-4e15-b4ff-ef55b2195a13 tempest-TestInstancesWithCinderVolumes-1775964317 None] Created volume successfully. Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba62d0b-7ded-481b-81a1-f142791f1166]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:20 devstack quobyte-client[83541]: System call of process 97176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:23:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 1 in 0.548s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:23:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.118s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:23:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-05a19d56-bc5c-4b66-b1a2-3810edeb569e req-a4b9f371-6629-4c34-9e47-b25fe99dad39 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:23:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-05a19d56-bc5c-4b66-b1a2-3810edeb569e req-a4b9f371-6629-4c34-9e47-b25fe99dad39 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:23:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-05a19d56-bc5c-4b66-b1a2-3810edeb569e req-a4b9f371-6629-4c34-9e47-b25fe99dad39 tempest-AttachVolumeNegativeTest-781168967 None] Terminate volume connection completed successfully. Sep 16 13:23:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-05a19d56-bc5c-4b66-b1a2-3810edeb569e req-a4b9f371-6629-4c34-9e47-b25fe99dad39 tempest-AttachVolumeNegativeTest-781168967 None] Deleting attachment 8a831aa5-847d-4452-95ac-d6e6cdb55ddd. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:23:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dae9b2d4-6b55-4ec1-82e2-1ce1a56240fb', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:23:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:23:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-a572e291-d48e-4e40-85d6-29d6902896e7 req-90024d51-fdc6-4305-9130-617aeb29415b tempest-TestInstancesWithCinderVolumes-1775964317 None] attachment_update completed successfully. Sep 16 13:23:31 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=25,cinder:UPDATE=11,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:23:31 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=15,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:23:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:23:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.262s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:23:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:24:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:24:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.128s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:24:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:24:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:24:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:24:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbbcd6c-ad36-410b-a418-f98a7c5bb06d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:24:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:00 devstack quobyte-client[83541]: System call of process 97966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:25:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" returned: 0 in 0.633s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:00 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2a8cc2e-8a3c-4748-91ea-a25a67f9d21f', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:25:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-00ed666c-510b-4351-8ef6-7ef5ae8cd530 req-c58408c3-12b9-44fe-9c07-bb82534fff94 tempest-TestInstancesWithCinderVolumes-1775964317 None] attachment_update completed successfully. Sep 16 13:25:10 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a955b518-1cb2-46cf-a456-4da396e79a02]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2" returned: 0 in 0.505s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.567s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-f743d0da-7205-44e1-8395-7e4b5bab38f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54dd31fc-f27c-4bd1-a38a-3ba22399682c', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:25:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-b0b8c5df-b85e-40d1-b437-53f800d8da02 req-33a1ad1f-da97-4837-86cd-219225523ab4 tempest-TestInstancesWithCinderVolumes-1775964317 None] attachment_update completed successfully. Sep 16 13:25:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (04683576-798e-4b67-a9dd-5e28c0a2a641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c307621-ad6a-486d-b8c7-cb9ff4eb149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c307621-ad6a-486d-b8c7-cb9ff4eb149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-111711745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddda8830-09bc-4de3-b62c-714bcec6ba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:25:15Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0181ed86-667c-4880-9b3c-854869e9ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0181ed86-667c-4880-9b3c-854869e9ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de0909-496c-45e7-9208-ba8dff984552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de0909-496c-45e7-9208-ba8dff984552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddda8830-09bc-4de3-b62c-714bcec6ba3f', 'volume_name': 'volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5443dc5-e001-4d88-9e14-a0a26c21173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5443dc5-e001-4d88-9e14-a0a26c21173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0450f6b-a852-44b2-a997-c33dd75fdc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:15 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Volume ddda8830-09bc-4de3-b62c-714bcec6ba3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f', 'volume_size': 1} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-111711745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddda8830-09bc-4de3-b62c-714bcec6ba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3708e5236a463897f5b8aeab45a434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:25:15Z,use_quota=True,user_id='fc4b7758c4a042dc92b193bbf23a8930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Creating volume ddda8830-09bc-4de3-b62c-714bcec6ba3f {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:25:15 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:15 devstack quobyte-client[83541]: System call of process 98265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:25:15 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=91, name=volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f 1073741824" returned: 0 in 0.381s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f" returned: 0 in 0.077s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] <== create_volume: return (519ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:25:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.531s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0450f6b-a852-44b2-a997-c33dd75fdc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ada23-73b5-4755-bb0a-d6a854d6aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:25:16 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Volume volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f (ddda8830-09bc-4de3-b62c-714bcec6ba3f): created successfully Sep 16 13:25:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ada23-73b5-4755-bb0a-d6a854d6aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:25:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Flow 'volume_create_manager' (04683576-798e-4b67-a9dd-5e28c0a2a641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:25:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e0f928bb-c8e1-4ef0-ad01-0f2a5d007fb7 tempest-AttachVolumeNegativeTest-781168967 None] Created volume successfully. Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb88405-1e21-4675-8117-fc86d40d01d6]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f" returned: 0 in 0.482s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.540s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b12fbb8a-f2f3-470d-a170-3f5a5b219fe2', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:25:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-6ec08ddf-9d4e-4323-ad45-2116def29c54 req-5c78f658-1f0e-4c1b-9957-1b7515f5d9a4 tempest-AttachVolumeNegativeTest-781168967 None] attachment_update completed successfully. Sep 16 13:25:32 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:25:32 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:25:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-124de2f6-7404-4483-8f49-2f0f8c0b0043 req-fd714c79-e92e-413c-ab25-f9bea2f427be tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-124de2f6-7404-4483-8f49-2f0f8c0b0043 req-fd714c79-e92e-413c-ab25-f9bea2f427be tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-124de2f6-7404-4483-8f49-2f0f8c0b0043 req-fd714c79-e92e-413c-ab25-f9bea2f427be tempest-TestInstancesWithCinderVolumes-1775964317 None] Terminate volume connection completed successfully. Sep 16 13:25:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-124de2f6-7404-4483-8f49-2f0f8c0b0043 req-fd714c79-e92e-413c-ab25-f9bea2f427be tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleting attachment b2a8cc2e-8a3c-4748-91ea-a25a67f9d21f. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:25:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-2712f30c-44d6-4f79-97f6-863ac2ca4bd3-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-2712f30c-44d6-4f79-97f6-863ac2ca4bd3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:25:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-quobyte-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361d769-09a7-4a4a-a8e5-4fff69694c4d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" returned: 0 in 0.530s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" returned: 0 in 0.125s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-2712f30c-44d6-4f79-97f6-863ac2ca4bd3" released by "delete_volume" :: held 0.838s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:25:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-dc7f32a6-5773-45ba-ba35-f3f9884f644c req-27ff3f66-8bc9-4bc2-9d92-76f8015d24d5 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-dc7f32a6-5773-45ba-ba35-f3f9884f644c req-27ff3f66-8bc9-4bc2-9d92-76f8015d24d5 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:25:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-dc7f32a6-5773-45ba-ba35-f3f9884f644c req-27ff3f66-8bc9-4bc2-9d92-76f8015d24d5 tempest-AttachVolumeNegativeTest-781168967 None] Terminate volume connection completed successfully. Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-dc7f32a6-5773-45ba-ba35-f3f9884f644c req-27ff3f66-8bc9-4bc2-9d92-76f8015d24d5 tempest-AttachVolumeNegativeTest-781168967 None] Deleting attachment b12fbb8a-f2f3-470d-a170-3f5a5b219fe2. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:25:50 devstack cinder-volume[83513]: WARNING cinder.quota [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125571357-1647991289 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125571357-1647991289, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:25:50 devstack cinder-volume[83513]: WARNING cinder.quota [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125571357-1647991289 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2125571357-1647991289, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Created reservations ['334abfba-4f47-4dbd-ac9c-8e906c42ae8b', '2fe838a1-0287-4d0d-bfc0-9b3e44d12a25', 'acc17398-dd1b-41f5-81e4-2f6576b7beec', '84d2dbe0-c91c-4331-bc63-4a900f1ab9f1'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:25:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleted volume successfully. Sep 16 13:25:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-297b19b1-b135-4aff-b51e-e2ed5ae75829 tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-2712f30c-44d6-4f79-97f6-863ac2ca4bd3-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:00 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:26:00 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-ddda8830-09bc-4de3-b62c-714bcec6ba3f-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-ddda8830-09bc-4de3-b62c-714bcec6ba3f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:06 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-quobyte-ddda8830-09bc-4de3-b62c-714bcec6ba3f" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-ddda8830-09bc-4de3-b62c-714bcec6ba3f" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b34e0e3-47cb-4158-a88c-ee688a455a24]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:06 devstack quobyte-client[83541]: System call of process 98497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f" returned: 0 in 0.428s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ddda8830-09bc-4de3-b62c-714bcec6ba3f" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-ddda8830-09bc-4de3-b62c-714bcec6ba3f" released by "delete_volume" :: held 0.659s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Created reservations ['5c9213b6-c099-4dcf-88e6-956e159a2553', '1788ab81-d1e9-4aa4-afc7-805a7a2a4b57', 'ecf3efda-3e73-4eb7-871b-31004f1430e4', '45e8e4c3-fdb2-48c4-b5b5-10acf8c5281f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.117s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-e0b6bffa-e95c-451b-b695-a6855712ce89-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Deleted volume successfully. Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-e0b6bffa-e95c-451b-b695-a6855712ce89-delete_volume" acquired by "delete_volume" :: waited 0.164s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f2fab691-771c-4a3a-98c6-ab44892375e5 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-ddda8830-09bc-4de3-b62c-714bcec6ba3f-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-quobyte-e0b6bffa-e95c-451b-b695-a6855712ce89" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-e0b6bffa-e95c-451b-b695-a6855712ce89" acquired by "delete_volume" :: waited 0.019s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea816752-3a71-48d1-a161-af342b98250e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89" returned: 0 in 0.408s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e0b6bffa-e95c-451b-b695-a6855712ce89" returned: 0 in 0.101s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-e0b6bffa-e95c-451b-b695-a6855712ce89" released by "delete_volume" :: held 0.666s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Created reservations ['399881e8-64ff-448a-b0cb-00cc3ee2806c', '66cd809a-977a-4837-9512-dbebd5ae0ccd', 'f695fda4-2305-4731-8908-40fbbdda48a0', 'c15b0201-13cd-4401-801b-39a282b10af2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.087s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Deleted volume successfully. Sep 16 13:26:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-959aff25-3049-4da1-b2b2-c0fb4d92b2a8 tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-e0b6bffa-e95c-451b-b695-a6855712ce89-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-0ba34db5-890a-4405-b635-6be9ff0b30a4-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-0ba34db5-890a-4405-b635-6be9ff0b30a4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "cinder-quobyte-0ba34db5-890a-4405-b635-6be9ff0b30a4" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-0ba34db5-890a-4405-b635-6be9ff0b30a4" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec1f42b-a73c-4e1f-9581-424a932f9c91]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4" returned: 0 in 0.408s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0ba34db5-890a-4405-b635-6be9ff0b30a4" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-quobyte-0ba34db5-890a-4405-b635-6be9ff0b30a4" released by "delete_volume" :: held 0.668s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Created reservations ['c38998f3-6d65-4c98-9679-d1f9f9b288ac', '7641a414-9ba6-4983-8a04-9cb48622ca72', '26de7409-3815-411d-8e79-33277faaf6de', 'fdac5a96-7e66-41f2-9946-b73b91d7be19'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.109s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Deleted volume successfully. Sep 16 13:26:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4a8cbe49-b644-4a86-a808-bab6f83e50bd tempest-AttachVolumeNegativeTest-781168967 None] Lock "cinder-0ba34db5-890a-4405-b635-6be9ff0b30a4-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a4754e64-4c11-4b60-9441-51f033299342 req-f237fa7b-6f32-4431-8496-4eb0f03b77f7 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-a4754e64-4c11-4b60-9441-51f033299342 req-f237fa7b-6f32-4431-8496-4eb0f03b77f7 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-a4754e64-4c11-4b60-9441-51f033299342 req-f237fa7b-6f32-4431-8496-4eb0f03b77f7 tempest-TestInstancesWithCinderVolumes-1775964317 None] Terminate volume connection completed successfully. Sep 16 13:26:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-a4754e64-4c11-4b60-9441-51f033299342 req-f237fa7b-6f32-4431-8496-4eb0f03b77f7 tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleting attachment 54dd31fc-f27c-4bd1-a38a-3ba22399682c. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:26:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:20 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:26:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Flow 'volume_create_manager' (8945ef44-baa2-4b81-bc7a-03e3f7ac1555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:26:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9869786-f113-4799-9219-3d378b331bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9869786-f113-4799-9219-3d378b331bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1716724126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea142a545e2d48a79174e0934bc23f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:26:21Z,use_quota=True,user_id='776e2691e7d243b6ab50583678d13fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0528f6-6748-4d51-8a93-f26e686a72d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0528f6-6748-4d51-8a93-f26e686a72d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a6edb5-a33e-4cc1-befe-c13b6d85fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a6edb5-a33e-4cc1-befe-c13b6d85fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e', 'volume_name': 'volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d2db7-1c3c-4a12-ad67-1f7f8fcea9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d2db7-1c3c-4a12-ad67-1f7f8fcea9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a1c62c-0d6e-4793-9c26-1f13af296921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:21 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e', 'volume_size': 1} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1716724126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea142a545e2d48a79174e0934bc23f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:26:21Z,use_quota=True,user_id='776e2691e7d243b6ab50583678d13fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Creating volume f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:26:21 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:21 devstack quobyte-client[83541]: System call of process 98523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:26:21 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=92, name=volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-f743d0da-7205-44e1-8395-7e4b5bab38f2-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-f743d0da-7205-44e1-8395-7e4b5bab38f2-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e 1073741824" returned: 0 in 0.604s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" returned: 0 in 0.351s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] <== create_volume: return (1001ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a1c62c-0d6e-4793-9c26-1f13af296921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57824c1-50fd-4d24-a4b0-4901e7c93e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:26:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-quobyte-f743d0da-7205-44e1-8395-7e4b5bab38f2" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e (f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e): created successfully Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57824c1-50fd-4d24-a4b0-4901e7c93e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Flow 'volume_create_manager' (8945ef44-baa2-4b81-bc7a-03e3f7ac1555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:26:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-eff556c4-95e4-40e3-9937-3f299004b092 req-6e37a9ac-fc1a-465d-a23b-4106b82e9a33 tempest-VolumesSnapshotsTestJSON-1281189318 None] Created volume successfully. Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-f743d0da-7205-44e1-8395-7e4b5bab38f2" acquired by "delete_volume" :: waited 0.106s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ba6ba-51fe-4ec3-b135-fe610f4e0193]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:22 devstack quobyte-client[83541]: System call of process 98529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2" returned: 0 in 0.629s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f743d0da-7205-44e1-8395-7e4b5bab38f2" returned: 0 in 0.179s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-f743d0da-7205-44e1-8395-7e4b5bab38f2" released by "delete_volume" :: held 1.041s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:23 devstack cinder-volume[83513]: WARNING cinder.quota [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503511179-946554877 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503511179-946554877, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:26:23 devstack cinder-volume[83513]: WARNING cinder.quota [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503511179-946554877 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1503511179-946554877, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:26:23 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Creating offline snapshot 313419ae-da75-4ece-9bce-8816ddf786d1 of volume f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff4fe8-d663-44c1-a6d7-a52a37682e0f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Created reservations ['6112db87-48bd-4b35-be44-00e0fecaa46a', '4012cfbe-cf77-459f-b981-e4c34fd9c55c', 'd95333b6-936a-47bf-8d45-2e02f128c81f', '1aefe06c-84d6-4f3e-ad10-5f7a3b1cdd64'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:24 devstack quobyte-client[83541]: System call of process 98534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" returned: 0 in 0.820s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.268s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleted volume successfully. Sep 16 13:26:25 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=93, name=volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 1G" returned: 0 in 0.469s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb54c798-69f3-4cbb-8a67-f05c24d3235d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-f743d0da-7205-44e1-8395-7e4b5bab38f2-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "qemu-img rebase -u -b volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.287s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.139s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:26:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.228s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.info" returned: 0 in 0.174s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.info" returned: 0 in 0.144s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:27 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-af024185-ef9f-4ebb-bf4d-2c8fa11d975b req-96c36fea-f925-445e-b2f1-ee88026676ad tempest-VolumesSnapshotsTestJSON-1281189318 None] Create snapshot completed successfully Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "cinder-313419ae-da75-4ece-9bce-8816ddf786d1-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-313419ae-da75-4ece-9bce-8816ddf786d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:28 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "cinder-quobyte-313419ae-da75-4ece-9bce-8816ddf786d1" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-313419ae-da75-4ece-9bce-8816ddf786d1" acquired by "_delete_snapshot" :: waited 0.665s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Deleting offline snapshot 313419ae-da75-4ece-9bce-8816ddf786d1 of volume f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] snapshot_file for this snap is: volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[41472630-3060-4356-90ef-b4181f4f6939]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:29 devstack quobyte-client[83541]: System call of process 98589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:26:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.768s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:29 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:26:29 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b75ee4-41ed-43b8-bbe3-fdd75db2850f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" returned: 0 in 0.552s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.373s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e.313419ae-da75-4ece-9bce-8816ddf786d1" returned: 0 in 0.248s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-313419ae-da75-4ece-9bce-8816ddf786d1" released by "_delete_snapshot" :: held 2.446s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" released by "delete_snapshot" :: held 3.124s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:31 devstack cinder-volume[83513]: DEBUG cinder.quota [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Created reservations ['8d3f9f1a-b5a6-46a0-b1d1-d497125467d1', '7a5ef1a6-a49c-4ad7-9387-5f86d5952fd7', 'a2f3fc12-d571-4203-884f-4690d0b14cd8', 'c88d1cf4-9dcb-43a2-834b-253b5250bc7a'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Delete snapshot completed successfully. Sep 16 13:26:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-c4b33dee-84a1-4f19-bff1-56b87b80f10d req-c9c699e5-b689-4b2b-8dc0-fad599f8e1cf tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-313419ae-da75-4ece-9bce-8816ddf786d1-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f3ce406f-83a2-466a-99bb-c3683fce9d6f req-5955ad59-4141-4aee-b30e-0fe2e43c3605 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-f3ce406f-83a2-466a-99bb-c3683fce9d6f req-5955ad59-4141-4aee-b30e-0fe2e43c3605 tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-f3ce406f-83a2-466a-99bb-c3683fce9d6f req-5955ad59-4141-4aee-b30e-0fe2e43c3605 tempest-TestInstancesWithCinderVolumes-1775964317 None] Terminate volume connection completed successfully. Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-f3ce406f-83a2-466a-99bb-c3683fce9d6f req-5955ad59-4141-4aee-b30e-0fe2e43c3605 tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleting attachment dae9b2d4-6b55-4ec1-82e2-1ce1a56240fb. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "cinder-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[83443b23-6a20-4032-8df5-7a9cbc1eaca3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" returned: 0 in 0.391s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" returned: 0 in 0.101s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-quobyte-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e" released by "delete_volume" :: held 0.681s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG cinder.quota [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Created reservations ['c11b9178-2952-4da8-8a56-c18558e76714', '4106c049-e91a-44ed-862a-fca99504ae56', '0e050c9e-1113-49fd-a036-c6c37d14c10c', 'c212b542-fdd1-4bb9-b89c-8aa2eab27eb4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:33 devstack cinder-volume[83513]: DEBUG cinder.manager [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Deleted volume successfully. Sep 16 13:26:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [req-6d07233c-65e6-4752-abab-d6be12dca1f6 req-22904460-b46f-4dab-8bee-17bae8863e14 tempest-VolumesSnapshotsTestJSON-1281189318 None] Lock "cinder-f14fcb08-a7e3-4e31-b68a-8f5fe7884d5e-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-0efc0d79-97ef-449a-99d1-19b08a4a8b77-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-0efc0d79-97ef-449a-99d1-19b08a4a8b77-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "cinder-quobyte-0efc0d79-97ef-449a-99d1-19b08a4a8b77" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-0efc0d79-97ef-449a-99d1-19b08a4a8b77" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafc040f-e9a1-4300-8b3d-7c30d2011b5d]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.478s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 1 in 0.589s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0efc0d79-97ef-449a-99d1-19b08a4a8b77" returned: 0 in 0.128s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-quobyte-0efc0d79-97ef-449a-99d1-19b08a4a8b77" released by "delete_volume" :: held 1.503s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:37 devstack cinder-volume[83513]: WARNING cinder.quota [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-693999160-1996782590 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-693999160-1996782590, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:26:37 devstack cinder-volume[83513]: WARNING cinder.quota [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-693999160-1996782590 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-693999160-1996782590, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:26:37 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Created reservations ['54ebd4e2-4ec4-497e-901d-487a29b25d5d', '3ed94f31-2ccf-4724-824a-b6597eb02256', '1666e808-4d4e-4f48-aebd-d228a194bad8', '1067f45b-493b-4fa6-9625-16739b2648fc'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.104s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Deleted volume successfully. Sep 16 13:26:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0db107a6-0edc-4832-a039-9b7a17a08e2d tempest-TestInstancesWithCinderVolumes-1775964317 None] Lock "cinder-0efc0d79-97ef-449a-99d1-19b08a4a8b77-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2cd133ec-b9f6-437c-b38c-819fe735808a tempest-BackendsCapabilitiesAdminTestsJSON-2038751249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83513) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.120s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4c0ae11c-bb70-4549-baa5-13c4bd6ee419 tempest-BackendsCapabilitiesAdminTestsJSON-2038751249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83513) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 13:26:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=42,cinder:INSERT=15,cinder:UPDATE=70,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:26:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=43,cinder:SELECT=36,cinder:INSERT=13,cinder:DELETE=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:26:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f7a17bde-3f8c-46ca-8a9b-e17c872b8a72 tempest-GroupsV320Test-1703437682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f7a17bde-3f8c-46ca-8a9b-e17c872b8a72 tempest-GroupsV320Test-1703437682 None] Group tempest-GroupsV320Test-Group-1388197994: creating Sep 16 13:26:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f7a17bde-3f8c-46ca-8a9b-e17c872b8a72 tempest-GroupsV320Test-1703437682 None] Group tempest-GroupsV320Test-Group-1388197994: created successfully Sep 16 13:26:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f7a17bde-3f8c-46ca-8a9b-e17c872b8a72 tempest-GroupsV320Test-1703437682 None] Create group completed successfully. Sep 16 13:26:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Created reservations ['141c680e-ba32-4245-b955-0c770d29912d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.213s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:26:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:26:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b26b8273-40a2-48f1-896a-d18958056118 tempest-GroupsV320Test-1703437682 None] Delete group completed successfully. Sep 16 13:27:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:27:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:27:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Flow 'volume_create_manager' (e6c12045-fbff-4d73-9cc7-09d44f22fa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896676c7-4878-42fc-b8da-0b448c3042d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896676c7-4878-42fc-b8da-0b448c3042d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1566820440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed1e5f-f5bd-4efb-9400-73312043504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417413c514e84fff94fba0cb0abc205a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:27:23Z,use_quota=True,user_id='1785c479f2a246b0ba950c17f8e0b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcae6315-19e3-449b-826d-cc0a266c4252),volume_type_id=bcae6315-19e3-449b-826d-cc0a266c4252)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f7ae6-c0bc-4522-b3e9-965f926d76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f7ae6-c0bc-4522-b3e9-965f926d76b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ab865f-f7af-4bf3-86b6-7688e5d52583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ab865f-f7af-4bf3-86b6-7688e5d52583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bed1e5f-f5bd-4efb-9400-73312043504e', 'volume_name': 'volume-7bed1e5f-f5bd-4efb-9400-73312043504e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc96036-905e-4673-b3c1-ef97a301ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc96036-905e-4673-b3c1-ef97a301ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bf41a2-1b9b-444a-b0aa-57eb904fadbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume 7bed1e5f-f5bd-4efb-9400-73312043504e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bed1e5f-f5bd-4efb-9400-73312043504e', 'volume_size': 1} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1566820440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed1e5f-f5bd-4efb-9400-73312043504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417413c514e84fff94fba0cb0abc205a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:27:23Z,use_quota=True,user_id='1785c479f2a246b0ba950c17f8e0b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcae6315-19e3-449b-826d-cc0a266c4252),volume_type_id=bcae6315-19e3-449b-826d-cc0a266c4252)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Creating volume 7bed1e5f-f5bd-4efb-9400-73312043504e {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:27:23 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:23 devstack quobyte-client[83541]: System call of process 98671 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:27:23 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=95, name=volume-7bed1e5f-f5bd-4efb-9400-73312043504e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e 1073741824" returned: 0 in 0.475s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e" returned: 0 in 0.132s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] <== create_volume: return (715ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:27:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bf41a2-1b9b-444a-b0aa-57eb904fadbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bed1e5f-f5bd-4efb-9400-73312043504e', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce50df-ec93-4554-b35c-0c1e88a79515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:24 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume volume-7bed1e5f-f5bd-4efb-9400-73312043504e (7bed1e5f-f5bd-4efb-9400-73312043504e): created successfully Sep 16 13:27:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce50df-ec93-4554-b35c-0c1e88a79515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Flow 'volume_create_manager' (e6c12045-fbff-4d73-9cc7-09d44f22fa43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:27:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-30bdbc41-e080-4c9a-85ab-97953533eebb tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Created volume successfully. Sep 16 13:27:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.123s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:25 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:27:25 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-177973e7-f5ae-4c2a-97d5-5a7e7fb0005f tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Retype volume completed successfully. Sep 16 13:27:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "cinder-7bed1e5f-f5bd-4efb-9400-73312043504e-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:27:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "cinder-7bed1e5f-f5bd-4efb-9400-73312043504e-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:27:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "cinder-quobyte-7bed1e5f-f5bd-4efb-9400-73312043504e" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "cinder-quobyte-7bed1e5f-f5bd-4efb-9400-73312043504e" acquired by "delete_volume" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f871edf-4ac0-4abe-962e-9c917cece309]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e" returned: 0 in 0.473s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7bed1e5f-f5bd-4efb-9400-73312043504e" returned: 0 in 0.122s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "cinder-quobyte-7bed1e5f-f5bd-4efb-9400-73312043504e" released by "delete_volume" :: held 0.774s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:27:28 devstack cinder-volume[83513]: WARNING cinder.quota [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:27:28 devstack cinder-volume[83513]: WARNING cinder.quota [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Created reservations ['dcc92f4d-d6e5-4a49-b4fd-0c3a13d1ce2d', '0df78e30-6d3d-4a42-a95b-3e67aa1db1bf', '1a0ebc48-ed18-4f99-a678-3a303f9d72a4', 'de472eac-4099-4181-84db-d60cc129305c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.159s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:28 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:27:29 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Deleted volume successfully. Sep 16 13:27:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5616be65-9c9c-4e4a-99ec-56fc81ca3d14 tempest-VolumeRetypeWithoutMigrationTest-1070399215 None] Lock "cinder-7bed1e5f-f5bd-4efb-9400-73312043504e-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:27:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:27:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:27:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Flow 'volume_create_manager' (71925992-ee1f-4920-9661-3d86705a96b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:27:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b3e1b4-cc3b-4449-8848-3c8ba105b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b3e1b4-cc3b-4449-8848-3c8ba105b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-347918940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ffed2-eb8b-45ab-a2c9-e2fa65855cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a02ad5856a4becaa797b51f0a792aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:27:37Z,use_quota=True,user_id='1ccf67ff777f46398b582bc1ab34677b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ab74ee-9973-4116-9ab2-8fb8ca1b822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ab74ee-9973-4116-9ab2-8fb8ca1b822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba36744-e7f3-4fc9-8b44-98ff403fee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba36744-e7f3-4fc9-8b44-98ff403fee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426ffed2-eb8b-45ab-a2c9-e2fa65855cb0', 'volume_name': 'volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9fec06-c719-4923-93a2-f6f3367f58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9fec06-c719-4923-93a2-f6f3367f58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c89638-c88c-4a10-a314-bf0e447467f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Volume 426ffed2-eb8b-45ab-a2c9-e2fa65855cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0', 'volume_size': 1} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-347918940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426ffed2-eb8b-45ab-a2c9-e2fa65855cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a02ad5856a4becaa797b51f0a792aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:27:37Z,use_quota=True,user_id='1ccf67ff777f46398b582bc1ab34677b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Creating volume 426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:27:37 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:37 devstack quobyte-client[83541]: System call of process 98684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:27:37 devstack quobyte-client[83541]: System call of process 98684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:27:37 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=96, name=volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 1073741824" returned: 0 in 0.378s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] <== create_volume: return (557ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c89638-c88c-4a10-a314-bf0e447467f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39a66f3-e4d1-4836-8afc-25e19b1ac410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:27:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Volume volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 (426ffed2-eb8b-45ab-a2c9-e2fa65855cb0): created successfully Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39a66f3-e4d1-4836-8afc-25e19b1ac410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:27:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Flow 'volume_create_manager' (71925992-ee1f-4920-9661-3d86705a96b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:27:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-38efad5c-80f7-43c9-9aaa-53f7f3491bb4 tempest-VolumesServicesTestJSON-761453296 None] Created volume successfully. Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Acquiring lock "cinder-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "cinder-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:27:39 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Acquiring lock "cinder-quobyte-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "cinder-quobyte-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" acquired by "delete_volume" :: waited 0.025s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26c91e-0416-4412-8ea3-1daf3301f56d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:27:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" returned: 0 in 0.479s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" returned: 0 in 0.165s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "cinder-quobyte-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0" released by "delete_volume" :: held 1.405s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.536s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:27:41 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Created reservations ['244d70ef-58f0-4a4f-90e3-51e21845cfbd', '0dccf5e2-6970-4979-801f-4e48ac3190b1', '4d879e54-6cf3-4a61-8b19-a1e1b64318ea', '2fa3c746-6428-4cf1-bfe6-4bd582dd6058'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.212s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:27:42 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:27:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Deleted volume successfully. Sep 16 13:27:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e3e3e971-8a9b-47d6-93fc-3ca98694403f tempest-VolumesServicesTestJSON-761453296 None] Lock "cinder-426ffed2-eb8b-45ab-a2c9-e2fa65855cb0-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:27:52 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:INSERT=5 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:27:52 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=18,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:28:02 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Flow 'volume_create_manager' (9e23b761-8f83-4733-81e4-076fa56c9807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8ff36d-911e-4266-a75e-b2fdf8445ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8ff36d-911e-4266-a75e-b2fdf8445ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1439745503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6c3d7d-866d-45d4-bd08-23229c6336af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ce54bec13c44c8b6a922382ace3a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:02Z,use_quota=True,user_id='84edbe6fe0b34e77bd9678fa2a8656d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20318c77-2a94-456c-8bb8-932f448b772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20318c77-2a94-456c-8bb8-932f448b772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804ba58d-a0ca-4611-b79b-e739b5f89591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804ba58d-a0ca-4611-b79b-e739b5f89591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6c3d7d-866d-45d4-bd08-23229c6336af', 'volume_name': 'volume-af6c3d7d-866d-45d4-bd08-23229c6336af', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d446d-cb4a-4f49-be15-55c767fc5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d446d-cb4a-4f49-be15-55c767fc5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7203c0f-d185-4baa-939d-73adbc24e4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Volume af6c3d7d-866d-45d4-bd08-23229c6336af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6c3d7d-866d-45d4-bd08-23229c6336af', 'volume_size': 1} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1439745503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6c3d7d-866d-45d4-bd08-23229c6336af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ce54bec13c44c8b6a922382ace3a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:02Z,use_quota=True,user_id='84edbe6fe0b34e77bd9678fa2a8656d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Creating volume af6c3d7d-866d-45d4-bd08-23229c6336af {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:28:02 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:28:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:03 devstack quobyte-client[83541]: System call of process 98814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:03 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=97, name=volume-af6c3d7d-866d-45d4-bd08-23229c6336af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af 1073741824" returned: 0 in 0.537s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af" returned: 0 in 0.148s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] <== create_volume: return (801ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7203c0f-d185-4baa-939d-73adbc24e4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6c3d7d-866d-45d4-bd08-23229c6336af', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0281b271-224b-4bb9-a3a0-1dd0bc69b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:04 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Volume volume-af6c3d7d-866d-45d4-bd08-23229c6336af (af6c3d7d-866d-45d4-bd08-23229c6336af): created successfully Sep 16 13:28:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0281b271-224b-4bb9-a3a0-1dd0bc69b18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:04 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Flow 'volume_create_manager' (9e23b761-8f83-4733-81e4-076fa56c9807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7ed81dfe-3ba0-40e4-8001-47d9e68395f9 tempest-TestMinimumBasicScenario-357746254 None] Created volume successfully. Sep 16 13:28:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Flow 'volume_create_manager' (248d6160-fe77-44c9-a523-6f3ea39b188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f240e0-ddf7-467d-80d7-f9acbddf0ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f240e0-ddf7-467d-80d7-f9acbddf0ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-629172230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3fafac-bf04-433e-af9c-12111bd5c3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1070cc1c2beb446bb1f7b7c12f32c152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:07Z,use_quota=True,user_id='b2165dcbe3db49c1ba9b56dde98104ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b49db-cf85-41d0-9cf4-9131c9967f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703b49db-cf85-41d0-9cf4-9131c9967f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bcccff-a073-4f7b-90fa-9097e861e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:07 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:28:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bcccff-a073-4f7b-90fa-9097e861e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c3fafac-bf04-433e-af9c-12111bd5c3a7', 'volume_name': 'volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8f79d0-a3ef-47f5-b41a-b4774b64eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8f79d0-a3ef-47f5-b41a-b4774b64eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f2eba-4689-43e8-9054-9923702ba6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:08 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 13:28:08 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Cloning 6c3fafac-bf04-433e-af9c-12111bd5c3a7 from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:28:09 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:28:09 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Image download 20.69 MB at 20.69 MB/s Sep 16 13:28:09 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a95f5-f8b8-46f5-9a21-c1ca351dcaca]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:10 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0128d6fe-f23e-48ed-b50e-00eac41a1750]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:10 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD Sep 16 13:28:10 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:28:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af" returned: 0 in 0.654s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.743s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-af6c3d7d-866d-45d4-bd08-23229c6336af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a953d4e7-a905-4313-9453-78fff38e75d5', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:28:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-86ced9de-9b84-4f4a-b93f-5903b9ec1539 req-26c5dd86-a8bf-461d-b824-a90f7155a5f5 tempest-TestMinimumBasicScenario-357746254 None] attachment_update completed successfully. Sep 16 13:28:12 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 16 13:28:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD" returned: 0 in 3.312s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:12 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 is fetched for user b2165dcbe3db49c1ba9b56dde98104ef. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:28:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[62770c29-76a0-46c9-a6d5-f2d31f8a048e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:13 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD Sep 16 13:28:13 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:28:16 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD" returned: 0 in 3.069s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-629172230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3fafac-bf04-433e-af9c-12111bd5c3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1070cc1c2beb446bb1f7b7c12f32c152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:07Z,use_quota=True,user_id='b2165dcbe3db49c1ba9b56dde98104ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Creating volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:28:16 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:16 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=98, name=volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 1073741824" returned: 0 in 0.457s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 0 in 0.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] <== create_volume: return (685ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Attempting download of 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa316364-6179-4384-81dc-74c901ea7d90]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_s7fcs_kz {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_s7fcs_kz" returned: 0 in 0.418s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_s7fcs_kz {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_s7fcs_kz" returned: 1 in 0.463s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_s7fcs_kz' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:28:18 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[af45b421-07fa-4d9c-993f-c42d809bc79d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:19 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 was qcow2, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:28:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:19 devstack quobyte-client[83541]: System call of process 99277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:19 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=98, name=volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 0 in 1.553s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:20 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2_44ylmphldevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:28:20 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Converted 112.00 MB image at 69.10 MB/s Sep 16 13:28:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 1G" returned: 0 in 0.194s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc17b37-2a0b-4703-b560-c8c73a0083e4]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 0 in 0.810s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 1 in 0.441s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Downloaded image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}])) to volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Temporary image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 for user b2165dcbe3db49c1ba9b56dde98104ef is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Marking volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Copying metadata from image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 to 6c3fafac-bf04-433e-af9c-12111bd5c3a7. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Creating volume glance metadata for volume 6c3fafac-bf04-433e-af9c-12111bd5c3a7 backed by image 8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f2eba-4689-43e8-9054-9923702ba6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7', 'volume_size': 1, 'image_id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '130746773c0d458ea8dbd8190699acc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2', 'created_at': datetime.datetime(2025, 9, 16, 10, 46, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 10, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e31bd99-69b8-4a1b-b99e-8a0eb304c2c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b137f576-63ef-46e6-bf65-943b49f8d8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Volume volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 (6c3fafac-bf04-433e-af9c-12111bd5c3a7): created successfully Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b137f576-63ef-46e6-bf65-943b49f8d8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Flow 'volume_create_manager' (248d6160-fe77-44c9-a523-6f3ea39b188a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:23 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a65a9c80-1881-4fe7-9e55-66a970fae8a1 tempest-VolumesImageMetadata-1121684006 None] Created volume successfully. Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Acquiring lock "cinder-6c3fafac-bf04-433e-af9c-12111bd5c3a7-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "cinder-6c3fafac-bf04-433e-af9c-12111bd5c3a7-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:25 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Acquiring lock "cinder-quobyte-6c3fafac-bf04-433e-af9c-12111bd5c3a7" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "cinder-quobyte-6c3fafac-bf04-433e-af9c-12111bd5c3a7" acquired by "delete_volume" :: waited 0.037s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ae0e0-0586-4367-a7b4-76a179ced05f]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:26 devstack quobyte-client[83541]: System call of process 99301 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 0 in 0.929s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:27 devstack quobyte-client[83541]: System call of process 99303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 1 in 0.897s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:28:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6c3fafac-bf04-433e-af9c-12111bd5c3a7" returned: 0 in 0.215s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "cinder-quobyte-6c3fafac-bf04-433e-af9c-12111bd5c3a7" released by "delete_volume" :: held 2.451s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Created reservations ['1727fc51-373f-4eff-b3b5-fe807e09ada4', 'daae3117-deee-45eb-bb37-d9a317c140e1', 'b801422a-8103-413d-8523-c768a20be7ee', '73b9d9c5-326f-426a-83a0-48e96302cc80'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.139s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:28 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:28:29 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Deleted volume successfully. Sep 16 13:28:29 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6ef79ebe-f446-46e7-9fde-66636875fc6c tempest-VolumesImageMetadata-1121684006 None] Lock "cinder-6c3fafac-bf04-433e-af9c-12111bd5c3a7-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (891cd701-2bd7-44df-b56a-83b127920705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eef3b56-7fa3-46c1-937c-4417c6f68702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eef3b56-7fa3-46c1-937c-4417c6f68702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1227504057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b56aa-c138-4af4-bcf8-29d25db908b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe3d037f7c743adbcd2c3e69ead32fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:34Z,use_quota=True,user_id='e7b1f1915c17473eb0f3ee1d9c2fed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4284c1af-faa5-45ec-ab13-4bc9ab43e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4284c1af-faa5-45ec-ab13-4bc9ab43e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906b38c-423b-46d3-b181-c84d1adb7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906b38c-423b-46d3-b181-c84d1adb7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71b56aa-c138-4af4-bcf8-29d25db908b7', 'volume_name': 'volume-c71b56aa-c138-4af4-bcf8-29d25db908b7', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41249ad0-9e04-4d46-aa02-259f9765efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41249ad0-9e04-4d46-aa02-259f9765efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265f722d-00e9-4f76-8a0a-bb9aa0456508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Volume c71b56aa-c138-4af4-bcf8-29d25db908b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71b56aa-c138-4af4-bcf8-29d25db908b7', 'volume_size': 1} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1227504057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b56aa-c138-4af4-bcf8-29d25db908b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe3d037f7c743adbcd2c3e69ead32fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:34Z,use_quota=True,user_id='e7b1f1915c17473eb0f3ee1d9c2fed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Creating volume c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:28:34 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:34 devstack quobyte-client[83541]: System call of process 99365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=99, name=volume-c71b56aa-c138-4af4-bcf8-29d25db908b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 1073741824" returned: 0 in 0.420s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7" returned: 0 in 0.192s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] <== create_volume: return (704ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:28:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265f722d-00e9-4f76-8a0a-bb9aa0456508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71b56aa-c138-4af4-bcf8-29d25db908b7', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9803390-db41-433d-bf50-218ba832094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:35 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Volume volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 (c71b56aa-c138-4af4-bcf8-29d25db908b7): created successfully Sep 16 13:28:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9803390-db41-433d-bf50-218ba832094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (891cd701-2bd7-44df-b56a-83b127920705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f80b84e3-0776-4b75-a7ae-64bd41798e20 tempest-VolumesDeleteCascade-223352961 None] Created volume successfully. Sep 16 13:28:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Creating offline snapshot ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 of volume c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:28:36 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a98ea8-6354-4c80-b306-f9a25e62e145]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7" returned: 0 in 0.697s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:37 devstack quobyte-client[83541]: System call of process 99378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:37 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=100, name=volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 1G" returned: 0 in 0.464s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:37 devstack quobyte-client[83541]: System call of process 99386 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img rebase -u -b volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.252s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.156s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.150s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.info" returned: 0 in 0.178s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.info" returned: 0 in 0.165s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e1a7de7f-5140-4489-b0cd-09e6f902b26e tempest-VolumesDeleteCascade-223352961 None] Create snapshot completed successfully Sep 16 13:28:39 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Creating offline snapshot 50af2492-795c-4280-a6ee-399954c7eef6 of volume c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[84875efb-573a-43fe-9257-6e7f7a106cd0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.593s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71b56aa-c138-4af4-bcf8-29d25db908b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=102, name=volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 1G" returned: 0 in 0.447s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.219s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:28:41 devstack quobyte-client[83541]: System call of process 99401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img rebase -u -b volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.211s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.082s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.750s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:41 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e0d6caa6-8f05-44f3-8a14-bae1127627f1 tempest-VolumesDeleteCascade-223352961 None] Create snapshot completed successfully Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-c71b56aa-c138-4af4-bcf8-29d25db908b7-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-c71b56aa-c138-4af4-bcf8-29d25db908b7-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Performing cascade delete. {{(pid=83513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-50af2492-795c-4280-a6ee-399954c7eef6-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-50af2492-795c-4280-a6ee-399954c7eef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-50af2492-795c-4280-a6ee-399954c7eef6" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-50af2492-795c-4280-a6ee-399954c7eef6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Deleting offline snapshot 50af2492-795c-4280-a6ee-399954c7eef6 of volume c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] snapshot_file for this snap is: volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec284f28-8a71-40ff-80bc-d159cf3fd534]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.401s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71b56aa-c138-4af4-bcf8-29d25db908b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102cd9e-ea0e-4b0b-b790-4b9eaacc4101]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.382s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71b56aa-c138-4af4-bcf8-29d25db908b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.262s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.50af2492-795c-4280-a6ee-399954c7eef6" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-50af2492-795c-4280-a6ee-399954c7eef6" released by "_delete_snapshot" :: held 1.479s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" released by "delete_snapshot" :: held 1.503s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['2b22a4d1-47f6-4453-b4d4-991aa64ce6bc', 'ec43fbf6-bf3d-44b9-ace1-790f7c893b0e', '25fc1b7a-a1c5-47bd-a2e9-5bebb6ca3e05', '0892eb8a-6093-47da-afdc-32ff488fa43c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:28:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Delete snapshot completed successfully. Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-50af2492-795c-4280-a6ee-399954c7eef6-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Deleting offline snapshot ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 of volume c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] snapshot_file for this snap is: volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf73179-3602-4996-bbaf-dab915e1ba27]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.350s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71b56aa-c138-4af4-bcf8-29d25db908b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:28:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[26101b3f-c3d1-4f29-aff6-cacab6e272d1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7" returned: 0 in 0.413s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:45 devstack quobyte-client[83541]: System call of process 99423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.201s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7.ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" returned: 0 in 0.086s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97" released by "_delete_snapshot" :: held 1.349s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" released by "delete_snapshot" :: held 1.373s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['b8c1b628-b18f-40e0-9ca4-a9e6f13db841', '3db36084-3dbe-4a35-ad3d-a0bb87f11390', '4cb2a607-9ef2-47bb-a090-e4f9ad7db0c6', '4e37c396-ea04-4ece-befd-12f840ce531d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:28:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Delete snapshot completed successfully. Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-ed3092e0-c9a3-4bb2-a5e8-dfe4a2613e97-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Snapshots deleted, issuing volume delete {{(pid=83513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[498e905b-4233-4904-8997-40f28465f3e4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7" returned: 0 in 0.402s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c71b56aa-c138-4af4-bcf8-29d25db908b7" returned: 0 in 0.083s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-c71b56aa-c138-4af4-bcf8-29d25db908b7" released by "delete_volume" :: held 0.647s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['116009fd-1a61-4ba6-8042-35c8d933c14f', '8bda4af7-4940-4705-bde5-0847d5869b33', 'bb865371-8438-4c5f-a48d-ac16f9b250cd', '31e622bd-7a32-48b0-a6b0-61baf04f3b4e'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.093s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:28:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Deleted volume successfully. Sep 16 13:28:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2911a4e2-8ccb-436b-a0d9-b5f89d507116 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-c71b56aa-c138-4af4-bcf8-29d25db908b7-delete_volume" released by "delete_volume" :: held 5.749s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:28:48 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (f75745e7-6ee2-41e4-9c2c-040bf35b6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd1497f-d75a-4cdc-bb94-ccbf2056e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd1497f-d75a-4cdc-bb94-ccbf2056e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-230282202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe3d037f7c743adbcd2c3e69ead32fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:48Z,use_quota=True,user_id='e7b1f1915c17473eb0f3ee1d9c2fed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8376cb-0b77-4117-b35b-f7c4b3ae1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8376cb-0b77-4117-b35b-f7c4b3ae1c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a47dd-0ba5-4e41-ae61-615bccd02587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a47dd-0ba5-4e41-ae61-615bccd02587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37', 'volume_name': 'volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921d0583-05e7-4504-889f-49ae7019fb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921d0583-05e7-4504-889f-49ae7019fb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341b2fd1-0d8d-4b43-b419-ece5bbffa641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:48 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Volume e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37', 'volume_size': 1} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-230282202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe3d037f7c743adbcd2c3e69ead32fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:48Z,use_quota=True,user_id='e7b1f1915c17473eb0f3ee1d9c2fed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Creating volume e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:28:48 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:28:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:48 devstack quobyte-client[83541]: System call of process 99433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:28:48 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=103, name=volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 1073741824" returned: 0 in 0.385s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] <== create_volume: return (563ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341b2fd1-0d8d-4b43-b419-ece5bbffa641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc09501-ce2c-4995-9351-c8d854e85a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:49 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Volume volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 (e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37): created successfully Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc09501-ce2c-4995-9351-c8d854e85a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (f75745e7-6ee2-41e4-9c2c-040bf35b6f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-68faeee7-9b9b-4387-b8cb-ba38707adf49 tempest-VolumesDeleteCascade-223352961 None] Created volume successfully. Sep 16 13:28:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Creating offline snapshot 955526aa-8fbe-4c14-bbd2-2113bdef4092 of volume e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013fd82-e895-4a37-949f-aeb3cb1ea9ac]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.480s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:51 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=104, name=volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 1G" returned: 0 in 0.352s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img rebase -u -b volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.169s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.info" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.info" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:52 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=39,cinder:SELECT=44,cinder:DELETE=4,cinder:INSERT=12 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:28:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4f65f620-1a1b-4cfd-a6cd-ef1584fa5ca4 tempest-VolumesDeleteCascade-223352961 None] Create snapshot completed successfully Sep 16 13:28:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:28:54 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:28:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (d9fb2fa6-48bf-4872-b657-0d4e817647de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:28:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e23c200-0102-470d-9619-802476e17ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e23c200-0102-470d-9619-802476e17ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1897898907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faa1d7c-a133-446c-a936-340403dc1c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe3d037f7c743adbcd2c3e69ead32fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=955526aa-8fbe-4c14-bbd2-2113bdef4092,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:28:55Z,use_quota=True,user_id='e7b1f1915c17473eb0f3ee1d9c2fed84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a5eb96-6ce6-424c-97ea-3d8787865537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a5eb96-6ce6-424c-97ea-3d8787865537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537c6b7e-6ed5-4c29-b414-7f878b6c3315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537c6b7e-6ed5-4c29-b414-7f878b6c3315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3faa1d7c-a133-446c-a936-340403dc1c07', 'volume_name': 'volume-3faa1d7c-a133-446c-a936-340403dc1c07', 'volume_size': 1, 'snapshot_id': '955526aa-8fbe-4c14-bbd2-2113bdef4092'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a354ba-e001-4d0a-b055-8b65e509727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a354ba-e001-4d0a-b055-8b65e509727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f27720-58cd-434e-8046-995992010ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:28:55 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Volume 3faa1d7c-a133-446c-a936-340403dc1c07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3faa1d7c-a133-446c-a936-340403dc1c07', 'volume_size': 1, 'snapshot_id': '955526aa-8fbe-4c14-bbd2-2113bdef4092'} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092-3faa1d7c-a133-446c-a936-340403dc1c07" by "_create_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092-3faa1d7c-a133-446c-a936-340403dc1c07" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Creating volume 3faa1d7c-a133-446c-a936-340403dc1c07 from snapshot 955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:359}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" by "_copy_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] snapshot: 955526aa-8fbe-4c14-bbd2-2113bdef4092, volume: 3faa1d7c-a133-446c-a936-340403dc1c07, {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:404}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f18e2d-8623-48d8-b3d4-00cdda793334]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.468s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Creating direct copy from snapshot {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf0b58-f090-4e38-bc3f-6573425174ab]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:28:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.448s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:28:56 devstack cinder-volume[83513]: DEBUG cinder.utils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 not found in is_blk_device check {{(pid=83513) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 13:28:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:28:56 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=106, name=volume-3faa1d7c-a133-446c-a936-340403dc1c07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:29:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07" returned: 0 in 7.640s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3aacbd-923e-4316-a71b-274a4f0275d4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.752s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:04 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:29:04 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Converted 1024.00 MB image at 133.59 MB/s Sep 16 13:29:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:29:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" released by "_copy_volume_from_snapshot" :: held 9.915s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092-3faa1d7c-a133-446c-a936-340403dc1c07" released by "_create_volume_from_snapshot" :: held 9.957s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=41,cinder:UPDATE=44,cinder:INSERT=17,cinder:DELETE=5 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f27720-58cd-434e-8046-995992010ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3faa1d7c-a133-446c-a936-340403dc1c07', 'volume_size': 1, 'snapshot_id': '955526aa-8fbe-4c14-bbd2-2113bdef4092'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b625a6-9c6b-4f68-b69b-46ccb4973aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:05 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Volume volume-3faa1d7c-a133-446c-a936-340403dc1c07 (3faa1d7c-a133-446c-a936-340403dc1c07): created successfully Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b625a6-9c6b-4f68-b69b-46ccb4973aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:05 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Flow 'volume_create_manager' (d9fb2fa6-48bf-4872-b657-0d4e817647de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:05 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0484b3ef-29d9-4e5f-b1ce-1116d7837f2a tempest-VolumesDeleteCascade-223352961 None] Created volume successfully. Sep 16 13:29:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Performing cascade delete. {{(pid=83513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-955526aa-8fbe-4c14-bbd2-2113bdef4092-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-955526aa-8fbe-4c14-bbd2-2113bdef4092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Deleting offline snapshot 955526aa-8fbe-4c14-bbd2-2113bdef4092 of volume e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] snapshot_file for this snap is: volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf7a1a-327e-42f8-8091-70bdfde27b57]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.534s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b5fc5-ade1-4af5-b9d7-650e588a2a3f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:08 devstack quobyte-client[83541]: System call of process 99521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:29:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.880s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.571s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37.955526aa-8fbe-4c14-bbd2-2113bdef4092" returned: 0 in 0.146s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-955526aa-8fbe-4c14-bbd2-2113bdef4092" released by "_delete_snapshot" :: held 2.689s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" released by "delete_snapshot" :: held 2.725s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['a80401d3-cfe5-4020-a2d8-549cfb40a695', '77120d3d-5140-4e03-83bf-2dc25b498eeb', '214d4a32-1b6b-46fb-900d-8a0137b69b80', '5aae822b-f978-4149-83f8-b4a432a55c41'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Delete snapshot completed successfully. Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-955526aa-8fbe-4c14-bbd2-2113bdef4092-delete_snapshot" released by "delete_snapshot" :: held 3.256s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Snapshots deleted, issuing volume delete {{(pid=83513) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" acquired by "delete_volume" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2601bc87-7fcd-44e8-9690-4aa524907be4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.460s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37" released by "delete_volume" :: held 0.849s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['aba0cd5e-4713-4c27-9aa5-c17653cc5a77', '3767cf32-8531-44e4-b6b1-2c69be6b49b1', '3f1a0491-ae41-4f91-962d-b267b4198ecd', 'd7da9fc2-947d-4772-97bc-c5198e65962c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:12 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Deleted volume successfully. Sep 16 13:29:12 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7f61c3f9-6f5f-45de-87a2-b1958d528db9 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-e87a7b5b-3f0f-476b-a45e-7cc50f4d9d37-delete_volume" released by "delete_volume" :: held 5.289s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-3faa1d7c-a133-446c-a936-340403dc1c07-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-3faa1d7c-a133-446c-a936-340403dc1c07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b4982d-d586-4b94-958f-ec31568df805]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07" returned: 0 in 0.377s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-3faa1d7c-a133-446c-a936-340403dc1c07" returned: 0 in 0.104s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-quobyte-3faa1d7c-a133-446c-a936-340403dc1c07" released by "delete_volume" :: held 0.628s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Created reservations ['c921b0ee-a9fb-4da2-a095-5f79758e7819', 'f376177b-a052-441e-9ad2-0bae999b2228', '26f9e00d-95bb-4479-997d-23ed6d972e6a', '1fa7e973-420a-472b-9caf-f3238552f5ed'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.245s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:15 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Deleted volume successfully. Sep 16 13:29:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-2ca0fcd5-33e7-43f2-bcb7-ea67e1693327 tempest-VolumesDeleteCascade-223352961 None] Lock "cinder-3faa1d7c-a133-446c-a936-340403dc1c07-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Flow 'volume_create_manager' (8a617b47-9486-4c84-99be-7f515f50f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dee510-7059-4952-85a1-84549748d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dee510-7059-4952-85a1-84549748d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-598862432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c39d0b-29f9-4a85-8e11-16128e745ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c869534b76f403393dacd9a3f3b2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:22Z,use_quota=True,user_id='f794678ebdf1430d9c6de5def9448090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92e9c6f-4f07-4fce-a56f-3de1eca028b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92e9c6f-4f07-4fce-a56f-3de1eca028b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d43fae9-0b22-4da1-90b8-55f49e5f8901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d43fae9-0b22-4da1-90b8-55f49e5f8901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c39d0b-29f9-4a85-8e11-16128e745ce6', 'volume_name': 'volume-00c39d0b-29f9-4a85-8e11-16128e745ce6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfe57ea-1af4-4cff-8088-d1cfe8cb2cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfe57ea-1af4-4cff-8088-d1cfe8cb2cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c008056-a0cf-4906-be62-39f24a882e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Volume 00c39d0b-29f9-4a85-8e11-16128e745ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c39d0b-29f9-4a85-8e11-16128e745ce6', 'volume_size': 1} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-598862432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c39d0b-29f9-4a85-8e11-16128e745ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c869534b76f403393dacd9a3f3b2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:22Z,use_quota=True,user_id='f794678ebdf1430d9c6de5def9448090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Creating volume 00c39d0b-29f9-4a85-8e11-16128e745ce6 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:29:22 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:29:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:22 devstack quobyte-client[83541]: System call of process 99681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:29:22 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=107, name=volume-00c39d0b-29f9-4a85-8e11-16128e745ce6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 1073741824" returned: 0 in 0.680s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6" returned: 0 in 0.123s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c008056-a0cf-4906-be62-39f24a882e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c39d0b-29f9-4a85-8e11-16128e745ce6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4dd0d6-4a6f-4ce2-997a-ffb62fe7f895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:23 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Volume volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 (00c39d0b-29f9-4a85-8e11-16128e745ce6): created successfully Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4dd0d6-4a6f-4ce2-997a-ffb62fe7f895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Flow 'volume_create_manager' (8a617b47-9486-4c84-99be-7f515f50f873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:23 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ed50705a-3ccb-4be4-9a5e-5251ed01954d tempest-VolumesMetadataTest-1760814924 None] Created volume successfully. Sep 16 13:29:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Acquiring lock "cinder-00c39d0b-29f9-4a85-8e11-16128e745ce6-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:25 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "cinder-00c39d0b-29f9-4a85-8e11-16128e745ce6-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:26 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Acquiring lock "cinder-quobyte-00c39d0b-29f9-4a85-8e11-16128e745ce6" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "cinder-quobyte-00c39d0b-29f9-4a85-8e11-16128e745ce6" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2461ab0-4d7c-4b65-96cf-62c1bbd177a2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6" returned: 0 in 0.478s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-00c39d0b-29f9-4a85-8e11-16128e745ce6" returned: 0 in 0.152s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "cinder-quobyte-00c39d0b-29f9-4a85-8e11-16128e745ce6" released by "delete_volume" :: held 0.887s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Created reservations ['cadb12ec-417a-4f5e-9c01-6e26771eb23b', 'e1876817-358b-423e-a577-e744b95f7b80', '666c91e0-ad7d-4152-b633-5970af1d5ab9', '6cd8498f-cc11-4d1f-b390-1d65971bb397'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.092s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:27 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Deleted volume successfully. Sep 16 13:29:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-39d55e32-369d-4b0d-8ab2-8de5b7131b74 tempest-VolumesMetadataTest-1760814924 None] Lock "cinder-00c39d0b-29f9-4a85-8e11-16128e745ce6-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:32 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Flow 'volume_create_manager' (85489765-7379-43cc-9c08-aeebc1350d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b386aa67-6c25-4b87-b372-ff669a03f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b386aa67-6c25-4b87-b372-ff669a03f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-72577819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44747648-0cfb-4fc1-ba42-27dfb95a64bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e995bb257b144eea07ec07ecff85e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:33Z,use_quota=True,user_id='e7200d391d574b088f70f9db7dbee6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611d4754-2b5d-4586-b504-39772f260727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611d4754-2b5d-4586-b504-39772f260727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1190dae-5df7-4ed1-874d-1e5487d33691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1190dae-5df7-4ed1-874d-1e5487d33691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44747648-0cfb-4fc1-ba42-27dfb95a64bf', 'volume_name': 'volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a761a4-c036-4b36-8aa0-d876187f93ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a761a4-c036-4b36-8aa0-d876187f93ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f99724-f8e9-4190-ad4e-818c87dafd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:33 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Volume 44747648-0cfb-4fc1-ba42-27dfb95a64bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf', 'volume_size': 1} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-72577819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44747648-0cfb-4fc1-ba42-27dfb95a64bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e995bb257b144eea07ec07ecff85e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:33Z,use_quota=True,user_id='e7200d391d574b088f70f9db7dbee6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Creating volume 44747648-0cfb-4fc1-ba42-27dfb95a64bf {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:29:33 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:33 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=108, name=volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf 1073741824" returned: 0 in 0.431s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf" returned: 0 in 0.140s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] <== create_volume: return (657ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:29:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f99724-f8e9-4190-ad4e-818c87dafd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218be8b4-67ca-4910-9759-2e8d8fe593e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Volume volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf (44747648-0cfb-4fc1-ba42-27dfb95a64bf): created successfully Sep 16 13:29:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218be8b4-67ca-4910-9759-2e8d8fe593e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Flow 'volume_create_manager' (85489765-7379-43cc-9c08-aeebc1350d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-961e0c80-7674-45e6-bb99-d19ef74c0490 tempest-VolumesTransfersTest-1704829998 None] Created volume successfully. Sep 16 13:29:35 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1334dc41-9a68-4d59-b09c-648ef2bb1d32 tempest-VolumesTransfersTest-2135404336 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1334dc41-9a68-4d59-b09c-648ef2bb1d32 tempest-VolumesTransfersTest-2135404336 None] Transfer volume completed successfully. Sep 16 13:29:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Acquiring lock "cinder-44747648-0cfb-4fc1-ba42-27dfb95a64bf-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "cinder-44747648-0cfb-4fc1-ba42-27dfb95a64bf-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Acquiring lock "cinder-quobyte-44747648-0cfb-4fc1-ba42-27dfb95a64bf" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "cinder-quobyte-44747648-0cfb-4fc1-ba42-27dfb95a64bf" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc870c06-2d2e-4307-b3a6-8e7066428c8f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf" returned: 0 in 0.602s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-44747648-0cfb-4fc1-ba42-27dfb95a64bf" returned: 0 in 0.166s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "cinder-quobyte-44747648-0cfb-4fc1-ba42-27dfb95a64bf" released by "delete_volume" :: held 1.160s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:38 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Created reservations ['df8977d7-d692-472a-a9d1-5549d5c00c2d', '03ea623f-fc66-466c-baf5-155ddf8696e1', '7df55690-7925-4472-a396-0f4d0d0106aa', '298c3cf3-8060-4557-ab8f-ca463d1a679d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.145s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:39 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Deleted volume successfully. Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5e396bc1-78ff-4b2d-a8b5-e6816b315018 tempest-VolumesTransfersTest-674434801 None] Lock "cinder-44747648-0cfb-4fc1-ba42-27dfb95a64bf-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:40 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Flow 'volume_create_manager' (7cde58b6-d5eb-45ab-ae36-4fab05e982eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3442d1-56ea-463d-8923-1ff767ed7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3442d1-56ea-463d-8923-1ff767ed7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1459352878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b202e17-e745-4560-a222-68ba033a5b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e995bb257b144eea07ec07ecff85e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:40Z,use_quota=True,user_id='e7200d391d574b088f70f9db7dbee6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8087ac39-5716-4414-b237-04dfbf4e1ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8087ac39-5716-4414-b237-04dfbf4e1ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00731a32-b01d-4965-bdfa-ba51303fe89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00731a32-b01d-4965-bdfa-ba51303fe89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b202e17-e745-4560-a222-68ba033a5b80', 'volume_name': 'volume-5b202e17-e745-4560-a222-68ba033a5b80', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33324ab3-b8ef-4e1b-b22d-9f2a157a09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33324ab3-b8ef-4e1b-b22d-9f2a157a09db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f549f1-0b7b-453c-b542-9b69a714663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:40 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Volume 5b202e17-e745-4560-a222-68ba033a5b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b202e17-e745-4560-a222-68ba033a5b80', 'volume_size': 1} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1459352878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b202e17-e745-4560-a222-68ba033a5b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e995bb257b144eea07ec07ecff85e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:40Z,use_quota=True,user_id='e7200d391d574b088f70f9db7dbee6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Creating volume 5b202e17-e745-4560-a222-68ba033a5b80 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:29:40 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:29:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:41 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=109, name=volume-5b202e17-e745-4560-a222-68ba033a5b80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.272s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80 1073741824" returned: 0 in 0.690s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80" returned: 0 in 0.144s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] <== create_volume: return (897ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:29:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f549f1-0b7b-453c-b542-9b69a714663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b202e17-e745-4560-a222-68ba033a5b80', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ee1d1-ab08-4d37-8d20-1a7963fa194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:42 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Volume volume-5b202e17-e745-4560-a222-68ba033a5b80 (5b202e17-e745-4560-a222-68ba033a5b80): created successfully Sep 16 13:29:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ee1d1-ab08-4d37-8d20-1a7963fa194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Flow 'volume_create_manager' (7cde58b6-d5eb-45ab-ae36-4fab05e982eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-797a9fb8-cbfc-4c54-8083-21ea145c63e7 tempest-VolumesTransfersTest-1704829998 None] Created volume successfully. Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Acquiring lock "cinder-5b202e17-e745-4560-a222-68ba033a5b80-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "cinder-5b202e17-e745-4560-a222-68ba033a5b80-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Acquiring lock "cinder-quobyte-5b202e17-e745-4560-a222-68ba033a5b80" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "cinder-quobyte-5b202e17-e745-4560-a222-68ba033a5b80" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[590450ef-02f8-4810-a7b0-50e58db43298]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80" returned: 0 in 0.456s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5b202e17-e745-4560-a222-68ba033a5b80" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "cinder-quobyte-5b202e17-e745-4560-a222-68ba033a5b80" released by "delete_volume" :: held 0.738s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Created reservations ['32d91aec-c255-42cd-ae58-a594809ede63', '7c903828-874b-49ed-be96-96f72a9bc64f', '2e02f950-63bb-4d5e-9f24-6eb194f67774', '5c28247c-7848-4b27-9acd-2d485af123d5'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.091s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:44 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:29:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Deleted volume successfully. Sep 16 13:29:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6904d3fe-2423-43d1-b0b0-c8cfd7485d1e tempest-VolumesTransfersTest-674434801 None] Lock "cinder-5b202e17-e745-4560-a222-68ba033a5b80-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=35,cinder:UPDATE=57,cinder:INSERT=13,cinder:DELETE=3 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:29:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Flow 'volume_create_manager' (5909895c-5809-457a-ab62-63826eaf78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a96af-b53c-41b2-88d6-661d8afe6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001a96af-b53c-41b2-88d6-661d8afe6b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1566921119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc7f38e-6e5c-4795-92c7-1fef6abb9374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9dfb43403ca4e43d9122d9e2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:55Z,use_quota=True,user_id='06a67ced3e1c4e9086d7b90dcc484491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36856dbb-141b-4f3a-a0d2-b36801a7d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36856dbb-141b-4f3a-a0d2-b36801a7d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042731b5-cb33-42f2-9310-aee5bb41e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042731b5-cb33-42f2-9310-aee5bb41e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc7f38e-6e5c-4795-92c7-1fef6abb9374', 'volume_name': 'volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e69bd-c254-46fe-8e70-c15bc4c8ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01e69bd-c254-46fe-8e70-c15bc4c8ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfda96-8e97-4663-9eac-36d95cb7c143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:54 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Volume 0bc7f38e-6e5c-4795-92c7-1fef6abb9374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374', 'volume_size': 1} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1566921119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc7f38e-6e5c-4795-92c7-1fef6abb9374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9dfb43403ca4e43d9122d9e2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:29:55Z,use_quota=True,user_id='06a67ced3e1c4e9086d7b90dcc484491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Creating volume 0bc7f38e-6e5c-4795-92c7-1fef6abb9374 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:29:54 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:29:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:55 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=110, name=volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 1073741824" returned: 0 in 0.475s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" returned: 0 in 0.143s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] <== create_volume: return (696ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cfda96-8e97-4663-9eac-36d95cb7c143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0cda9-241b-42e3-9527-31405ed176f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:29:55 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Volume volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 (0bc7f38e-6e5c-4795-92c7-1fef6abb9374): created successfully Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0cda9-241b-42e3-9527-31405ed176f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:29:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Flow 'volume_create_manager' (5909895c-5809-457a-ab62-63826eaf78bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:29:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-569658d2-cf63-4149-a001-3c11f54a6b24 tempest-VolumesTransfersV355Test-863583457 None] Created volume successfully. Sep 16 13:29:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-be315fcf-5de6-420e-863c-b92caf163d41 tempest-VolumesTransfersV355Test-537674688 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-be315fcf-5de6-420e-863c-b92caf163d41 tempest-VolumesTransfersV355Test-537674688 None] Transfer volume completed successfully. Sep 16 13:29:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "cinder-0bc7f38e-6e5c-4795-92c7-1fef6abb9374-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-0bc7f38e-6e5c-4795-92c7-1fef6abb9374-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:59 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "cinder-quobyte-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-quobyte-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[797cf348-8e25-473a-b032-23ab67b50e8b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" returned: 0 in 0.448s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:29:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-quobyte-0bc7f38e-6e5c-4795-92c7-1fef6abb9374" released by "delete_volume" :: held 0.715s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Created reservations ['c2204ec8-8620-4930-b9c6-3b8d15b407c6', '8df80bef-c965-4ca2-b9f2-5f7fa51ddca3', '9fbda274-9ba1-489f-b60a-56798392e418', '39cee9be-36c2-45d7-820d-1ac2393da4e9'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Deleted volume successfully. Sep 16 13:30:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-79485bd3-2744-4a7c-bb18-0597f80f5a01 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-0bc7f38e-6e5c-4795-92c7-1fef6abb9374-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Flow 'volume_create_manager' (09318faa-4996-426e-ac47-69dd60e87766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623a0946-5bc2-4130-9466-ba276f0980e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623a0946-5bc2-4130-9466-ba276f0980e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-648113446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476d5db4-097b-43f2-933d-9684f8899cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9dfb43403ca4e43d9122d9e2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:02Z,use_quota=True,user_id='06a67ced3e1c4e9086d7b90dcc484491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975b964b-11dd-4868-affe-7e6cd30aca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975b964b-11dd-4868-affe-7e6cd30aca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f2d8f6-a2e7-4c47-8d9f-c1aac833fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f2d8f6-a2e7-4c47-8d9f-c1aac833fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476d5db4-097b-43f2-933d-9684f8899cfc', 'volume_name': 'volume-476d5db4-097b-43f2-933d-9684f8899cfc', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a215e75e-75e6-447c-83a4-715f2ed50adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a215e75e-75e6-447c-83a4-715f2ed50adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684b27b3-f64e-4713-90b3-5317cdb4df94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:01 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Volume 476d5db4-097b-43f2-933d-9684f8899cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476d5db4-097b-43f2-933d-9684f8899cfc', 'volume_size': 1} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-648113446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476d5db4-097b-43f2-933d-9684f8899cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07174a9dfb43403ca4e43d9122d9e2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:02Z,use_quota=True,user_id='06a67ced3e1c4e9086d7b90dcc484491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Creating volume 476d5db4-097b-43f2-933d-9684f8899cfc {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:01 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:02 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=111, name=volume-476d5db4-097b-43f2-933d-9684f8899cfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:02 devstack quobyte-client[83541]: System call of process 99744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc 1073741824" returned: 0 in 0.324s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc" returned: 0 in 0.082s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684b27b3-f64e-4713-90b3-5317cdb4df94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476d5db4-097b-43f2-933d-9684f8899cfc', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07b3950-cd89-4a56-8ac4-257a54b2c692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:02 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Volume volume-476d5db4-097b-43f2-933d-9684f8899cfc (476d5db4-097b-43f2-933d-9684f8899cfc): created successfully Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07b3950-cd89-4a56-8ac4-257a54b2c692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:02 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Flow 'volume_create_manager' (09318faa-4996-426e-ac47-69dd60e87766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-621947bb-a228-4a6c-b41c-1511da454e16 tempest-VolumesTransfersV355Test-863583457 None] Created volume successfully. Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "cinder-476d5db4-097b-43f2-933d-9684f8899cfc-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-476d5db4-097b-43f2-933d-9684f8899cfc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "cinder-quobyte-476d5db4-097b-43f2-933d-9684f8899cfc" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-quobyte-476d5db4-097b-43f2-933d-9684f8899cfc" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a229b3-d2cd-4bc4-895b-eb9d7554b457]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc" returned: 0 in 0.436s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-476d5db4-097b-43f2-933d-9684f8899cfc" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-quobyte-476d5db4-097b-43f2-933d-9684f8899cfc" released by "delete_volume" :: held 0.675s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Created reservations ['76efe045-4c02-46d5-b059-966c279a196d', '5ad618cf-17c8-4fdd-8e7b-b71f10c49cce', '37aa823a-3a95-4fb7-816f-9b03f3ed0ba1', 'a4558369-ad97-4300-908a-4a7f2cdccf7e'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:DELETE=6,cinder:UPDATE=65,cinder:SELECT=48,cinder:INSERT=15 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:05 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:05 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Deleted volume successfully. Sep 16 13:30:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9c7b9f03-d006-4027-a22e-b2c56ae59bb7 tempest-VolumesTransfersV355Test-426383306 None] Lock "cinder-476d5db4-097b-43f2-933d-9684f8899cfc-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:14 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:14 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Flow 'volume_create_manager' (88ca680d-ddaa-4514-9b62-948385ea7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:14 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e789d-ef1a-4b66-94e9-2347cce9c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e789d-ef1a-4b66-94e9-2347cce9c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-16966064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970f1e1abd464c54862a052d2197b44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:15Z,use_quota=True,user_id='d99027fd243b4069b8d909be03687f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c0b96f-17bb-4b6c-8143-c4f5ad64511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c0b96f-17bb-4b6c-8143-c4f5ad64511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a18ccf1-0da0-41d4-a454-b0352c4a7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a18ccf1-0da0-41d4-a454-b0352c4a7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea', 'volume_name': 'volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea', 'volume_size': 2}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89de6b43-50bc-4792-bb26-379df3172c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89de6b43-50bc-4792-bb26-379df3172c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f732322f-afec-4a24-ba09-183f90d75088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:15 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Volume 13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea', 'volume_size': 2} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-16966064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970f1e1abd464c54862a052d2197b44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:15Z,use_quota=True,user_id='d99027fd243b4069b8d909be03687f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Creating volume 13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:15 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea 2147483648 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:15 devstack quobyte-client[83541]: System call of process 99809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:15 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=112, name=volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea 2147483648" returned: 0 in 0.559s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" returned: 0 in 0.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f732322f-afec-4a24-ba09-183f90d75088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea', 'volume_size': 2}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5557703f-606d-4ee3-9160-bb4021e87499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:16 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Volume volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea (13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea): created successfully Sep 16 13:30:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5557703f-606d-4ee3-9160-bb4021e87499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Flow 'volume_create_manager' (88ca680d-ddaa-4514-9b62-948385ea7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7b772c3f-1ec1-4ba4-b4e4-f210df37ff0a tempest-VolumesCloneNegativeTest-1487015047 None] Created volume successfully. Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Acquiring lock "cinder-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "cinder-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Acquiring lock "cinder-quobyte-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "cinder-quobyte-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c6ad8-dd4c-4bcd-bc9b-ddc206e6f488]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" returned: 0 in 0.457s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" returned: 0 in 0.123s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "cinder-quobyte-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea" released by "delete_volume" :: held 0.745s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Created reservations ['5edeffa5-b1ee-4b61-b6e8-1cf246d363fc', 'fffcd9d3-181b-4276-8ea3-c9995d54f430', '5007879e-1f4f-4519-93c8-d720577f7fb6', 'ccd2656e-6762-4b3e-8b21-b9bea266b5b8'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:18 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:18 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Deleted volume successfully. Sep 16 13:30:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-cb6d981a-6884-459f-b029-b5dfcb82f245 tempest-VolumesCloneNegativeTest-1487015047 None] Lock "cinder-13fb1794-94e9-4e1a-8d5c-8cdae9e2e0ea-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:23 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (4c8ca074-b73e-40ee-a6ab-be0581d85e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0d1e14-28f0-4bd7-a59a-00b69acdab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0d1e14-28f0-4bd7-a59a-00b69acdab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-894711138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863f69ff-b589-49e6-9d5d-aff400d8aefe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:23Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee753ba-0afb-46ac-be9e-34615e138919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee753ba-0afb-46ac-be9e-34615e138919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba65e35f-26f6-4f68-85d6-a6a2d412bee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba65e35f-26f6-4f68-85d6-a6a2d412bee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863f69ff-b589-49e6-9d5d-aff400d8aefe', 'volume_name': 'volume-863f69ff-b589-49e6-9d5d-aff400d8aefe', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34194a1-7ec7-4aca-ae26-4a1b72442dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34194a1-7ec7-4aca-ae26-4a1b72442dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89de5a3a-f291-4166-be67-5464d39dad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:23 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Volume 863f69ff-b589-49e6-9d5d-aff400d8aefe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863f69ff-b589-49e6-9d5d-aff400d8aefe', 'volume_size': 1} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-894711138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863f69ff-b589-49e6-9d5d-aff400d8aefe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:23Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Creating volume 863f69ff-b589-49e6-9d5d-aff400d8aefe {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:23 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:23 devstack quobyte-client[83541]: System call of process 99820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:23 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=113, name=volume-863f69ff-b589-49e6-9d5d-aff400d8aefe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe 1073741824" returned: 0 in 0.354s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.533s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89de5a3a-f291-4166-be67-5464d39dad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863f69ff-b589-49e6-9d5d-aff400d8aefe', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701a50e3-ea45-4ceb-a551-96f6b9478050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:24 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Volume volume-863f69ff-b589-49e6-9d5d-aff400d8aefe (863f69ff-b589-49e6-9d5d-aff400d8aefe): created successfully Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701a50e3-ea45-4ceb-a551-96f6b9478050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:24 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (4c8ca074-b73e-40ee-a6ab-be0581d85e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:24 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6287b026-860d-416b-a5e1-20c17edd0099 tempest-VolumesListTestJSON-523774629 None] Created volume successfully. Sep 16 13:30:26 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (76ed57d7-1bb6-4f3d-810a-063f3aa3b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa10a7-f720-4d26-8ab0-bd19a3582352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa10a7-f720-4d26-8ab0-bd19a3582352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1771807275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3398d64-c2e8-452f-ab3f-cda0b3127630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:26Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61a0b5-5687-4aac-be47-30eed29308cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a61a0b5-5687-4aac-be47-30eed29308cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f66ec8a-fb72-47f2-965a-26fd16b00487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f66ec8a-fb72-47f2-965a-26fd16b00487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3398d64-c2e8-452f-ab3f-cda0b3127630', 'volume_name': 'volume-c3398d64-c2e8-452f-ab3f-cda0b3127630', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7e5927-6ce0-4127-b3f9-aeb5cc264d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7e5927-6ce0-4127-b3f9-aeb5cc264d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c05c79b-a163-480d-b2ce-dff36780b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Volume c3398d64-c2e8-452f-ab3f-cda0b3127630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3398d64-c2e8-452f-ab3f-cda0b3127630', 'volume_size': 1} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1771807275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3398d64-c2e8-452f-ab3f-cda0b3127630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:26Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Creating volume c3398d64-c2e8-452f-ab3f-cda0b3127630 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:26 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:26 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=114, name=volume-c3398d64-c2e8-452f-ab3f-cda0b3127630, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 1073741824" returned: 0 in 0.341s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.489s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c05c79b-a163-480d-b2ce-dff36780b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3398d64-c2e8-452f-ab3f-cda0b3127630', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe79a8-f714-4af3-b228-d5517becba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:26 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Volume volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 (c3398d64-c2e8-452f-ab3f-cda0b3127630): created successfully Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe79a8-f714-4af3-b228-d5517becba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:26 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (76ed57d7-1bb6-4f3d-810a-063f3aa3b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5e536f56-053c-48b8-b66a-4deea96e7525 tempest-VolumesListTestJSON-523774629 None] Created volume successfully. Sep 16 13:30:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (ec5287bf-46e1-421e-9855-836abbab2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f060cd2-516c-45a9-ac14-9d09005a87d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f060cd2-516c-45a9-ac14-9d09005a87d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1361669556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087d7986-8822-4992-91cf-29db21fc6e45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:27Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc83046-b817-4863-a4d2-5e90e9cea843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc83046-b817-4863-a4d2-5e90e9cea843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de92d5b-1b61-47f7-b308-525d7b6814be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de92d5b-1b61-47f7-b308-525d7b6814be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087d7986-8822-4992-91cf-29db21fc6e45', 'volume_name': 'volume-087d7986-8822-4992-91cf-29db21fc6e45', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e80a86-061f-4b11-adeb-9d1d0502abec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e80a86-061f-4b11-adeb-9d1d0502abec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30cdc2-ec83-40b7-a995-51ab0c8b5501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Volume 087d7986-8822-4992-91cf-29db21fc6e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087d7986-8822-4992-91cf-29db21fc6e45', 'volume_size': 1} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1361669556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087d7986-8822-4992-91cf-29db21fc6e45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f456fdcd0c3f4c0d91921d3d5517769f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:27Z,use_quota=True,user_id='c6900d2bf74f42198de4d664253f951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Creating volume 087d7986-8822-4992-91cf-29db21fc6e45 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:27 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:27 devstack quobyte-client[83541]: System call of process 99829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:27 devstack quobyte-client[83541]: System call of process 99829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:27 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=115, name=volume-087d7986-8822-4992-91cf-29db21fc6e45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45 1073741824" returned: 0 in 0.308s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] <== create_volume: return (450ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.460s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d30cdc2-ec83-40b7-a995-51ab0c8b5501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087d7986-8822-4992-91cf-29db21fc6e45', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c60e5e-ac44-425d-abe6-00ea9b584a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:28 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Volume volume-087d7986-8822-4992-91cf-29db21fc6e45 (087d7986-8822-4992-91cf-29db21fc6e45): created successfully Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c60e5e-ac44-425d-abe6-00ea9b584a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Flow 'volume_create_manager' (ec5287bf-46e1-421e-9855-836abbab2666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:28 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fd239a72-4750-47f5-bc5c-b60d76c4f741 tempest-VolumesListTestJSON-523774629 None] Created volume successfully. Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-087d7986-8822-4992-91cf-29db21fc6e45-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "cinder-087d7986-8822-4992-91cf-29db21fc6e45-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:33 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-quobyte-087d7986-8822-4992-91cf-29db21fc6e45" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-087d7986-8822-4992-91cf-29db21fc6e45" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae2526f-d357-459c-80ed-67f584b54d0c]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45" returned: 0 in 0.784s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-087d7986-8822-4992-91cf-29db21fc6e45" returned: 0 in 0.211s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-087d7986-8822-4992-91cf-29db21fc6e45" released by "delete_volume" :: held 1.239s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Created reservations ['6cf5ab51-9f8b-4b92-bbde-2eaaa57fb4a5', '4b1057cf-320e-4167-a6c2-b00ac4ffa1e1', '624dc63d-58a2-411b-838b-c9ff972ca63e', 'a2bb3c41-7c11-4636-bc6d-d0ebb6ab69a7'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Deleted volume successfully. Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-c3398d64-c2e8-452f-ab3f-cda0b3127630-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-16f4c840-d8fb-45f4-b070-92a20315b00e tempest-VolumesListTestJSON-523774629 None] Lock "cinder-087d7986-8822-4992-91cf-29db21fc6e45-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "cinder-c3398d64-c2e8-452f-ab3f-cda0b3127630-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-quobyte-c3398d64-c2e8-452f-ab3f-cda0b3127630" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-c3398d64-c2e8-452f-ab3f-cda0b3127630" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a5e0e-1f13-4f4e-afb1-871f7a9cd35f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630" returned: 0 in 0.566s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c3398d64-c2e8-452f-ab3f-cda0b3127630" returned: 0 in 0.161s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-c3398d64-c2e8-452f-ab3f-cda0b3127630" released by "delete_volume" :: held 0.912s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Created reservations ['9205263f-ee2d-440e-ae8b-210e7af3f5b3', 'df342530-e676-4fe4-8a2e-bc492c74d069', 'e7e4e318-b76c-4666-945c-a8384accef9a', '85154942-cb3d-432e-a292-28620d6a0344'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:37 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Deleted volume successfully. Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bc86489b-c4ed-4bbc-ad31-98bd1ae6d446 tempest-VolumesListTestJSON-523774629 None] Lock "cinder-c3398d64-c2e8-452f-ab3f-cda0b3127630-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-863f69ff-b589-49e6-9d5d-aff400d8aefe-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "cinder-863f69ff-b589-49e6-9d5d-aff400d8aefe-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Acquiring lock "cinder-quobyte-863f69ff-b589-49e6-9d5d-aff400d8aefe" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-863f69ff-b589-49e6-9d5d-aff400d8aefe" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214a0c5-4d69-43f6-ad2c-4c1505a5e395]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe" returned: 0 in 0.574s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-863f69ff-b589-49e6-9d5d-aff400d8aefe" returned: 0 in 0.131s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "cinder-quobyte-863f69ff-b589-49e6-9d5d-aff400d8aefe" released by "delete_volume" :: held 0.950s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Created reservations ['95253928-63ad-4df6-b1e8-94ed0f5e671a', '3f3ce491-bf8e-4e54-9407-ea5e74941729', 'b2421d23-67eb-4fbe-86cd-9b24f25863c5', '6f1b6204-40b3-4f81-aba0-9cbf225071ee'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:40 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Deleted volume successfully. Sep 16 13:30:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e62adaa4-0daf-482b-bee7-9e2c67199a4b tempest-VolumesListTestJSON-523774629 None] Lock "cinder-863f69ff-b589-49e6-9d5d-aff400d8aefe-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.179s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:30:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Flow 'volume_create_manager' (8e86a3e8-1891-4e1c-a5cc-ab5825184121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ff3f1-2b21-4497-bfd9-cd0e650474ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646ff3f1-2b21-4497-bfd9-cd0e650474ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1503245072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2796856-ba32-4f63-9d78-a4fcfaff24ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6b35571062426085246a2592fe0eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:44Z,use_quota=True,user_id='cbb04fd41871433ab93387b70532e01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d8d90c-6da6-4ebd-89c7-1b247631a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d8d90c-6da6-4ebd-89c7-1b247631a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec10e09f-88ad-4d32-99b3-c50806984d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec10e09f-88ad-4d32-99b3-c50806984d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2796856-ba32-4f63-9d78-a4fcfaff24ab', 'volume_name': 'volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463c1cb9-658a-4f39-a535-1a25ca2e8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463c1cb9-658a-4f39-a535-1a25ca2e8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e33495d-5627-4795-9d7f-d87276db2b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:44 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Volume d2796856-ba32-4f63-9d78-a4fcfaff24ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab', 'volume_size': 1} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1503245072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2796856-ba32-4f63-9d78-a4fcfaff24ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6b35571062426085246a2592fe0eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:30:44Z,use_quota=True,user_id='cbb04fd41871433ab93387b70532e01b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Creating volume d2796856-ba32-4f63-9d78-a4fcfaff24ab {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:30:44 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:30:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:44 devstack quobyte-client[83541]: System call of process 99872 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:30:44 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=116, name=volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab 1073741824" returned: 0 in 0.384s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.616s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e33495d-5627-4795-9d7f-d87276db2b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cf9664-6176-4dde-8660-bb5c6b1f1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:30:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Volume volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab (d2796856-ba32-4f63-9d78-a4fcfaff24ab): created successfully Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cf9664-6176-4dde-8660-bb5c6b1f1084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:30:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Flow 'volume_create_manager' (8e86a3e8-1891-4e1c-a5cc-ab5825184121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:30:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e4913ee3-51d5-4e0d-b56b-a7dd2314574e tempest-VolumesNegativeTest-479040604 None] Created volume successfully. Sep 16 13:30:55 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:DELETE=4,cinder:UPDATE=42,cinder:SELECT=23,cinder:INSERT=9 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:30:55 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=67,cinder:DELETE=9,cinder:SELECT=39,cinder:INSERT=11 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:30:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-e53c4f1d-dc23-4fda-88dd-c83ecb6089bd req-efc07e20-60e7-4980-9467-4280b8073ca3 tempest-TestMinimumBasicScenario-357746254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-e53c4f1d-dc23-4fda-88dd-c83ecb6089bd req-efc07e20-60e7-4980-9467-4280b8073ca3 tempest-TestMinimumBasicScenario-357746254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-e53c4f1d-dc23-4fda-88dd-c83ecb6089bd req-efc07e20-60e7-4980-9467-4280b8073ca3 tempest-TestMinimumBasicScenario-357746254 None] Terminate volume connection completed successfully. Sep 16 13:30:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-e53c4f1d-dc23-4fda-88dd-c83ecb6089bd req-efc07e20-60e7-4980-9467-4280b8073ca3 tempest-TestMinimumBasicScenario-357746254 None] Deleting attachment a953d4e7-a905-4313-9453-78fff38e75d5. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "cinder-af6c3d7d-866d-45d4-bd08-23229c6336af-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "cinder-af6c3d7d-866d-45d4-bd08-23229c6336af-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:59 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "cinder-quobyte-af6c3d7d-866d-45d4-bd08-23229c6336af" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "cinder-quobyte-af6c3d7d-866d-45d4-bd08-23229c6336af" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b079f6-fe6a-477d-b70e-076eacdbf1e1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:30:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af" returned: 0 in 0.515s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-af6c3d7d-866d-45d4-bd08-23229c6336af" returned: 0 in 0.099s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "cinder-quobyte-af6c3d7d-866d-45d4-bd08-23229c6336af" released by "delete_volume" :: held 0.813s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Created reservations ['1faaef18-524e-4d9a-a906-c0d5bd1a6d5c', 'ecd92dd1-5f08-4bd3-b11d-dc9ba52fdbfd', '5c6c5d67-e061-43c2-8f60-7814965ced61', '85735e91-6bed-4a3d-994a-83778be16f37'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.115s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:01 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:31:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Deleted volume successfully. Sep 16 13:31:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c32a4837-a4c6-45b7-af9a-15a9879331f2 tempest-TestMinimumBasicScenario-357746254 None] Lock "cinder-af6c3d7d-866d-45d4-bd08-23229c6336af-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:10 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:31:11 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:31:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:31:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:31:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Acquiring lock "cinder-d2796856-ba32-4f63-9d78-a4fcfaff24ab-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "cinder-d2796856-ba32-4f63-9d78-a4fcfaff24ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Acquiring lock "cinder-quobyte-d2796856-ba32-4f63-9d78-a4fcfaff24ab" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "cinder-quobyte-d2796856-ba32-4f63-9d78-a4fcfaff24ab" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:30 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c76a2a3-2d41-4445-a604-a09c6a4395a0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab" returned: 0 in 0.517s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-d2796856-ba32-4f63-9d78-a4fcfaff24ab" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "cinder-quobyte-d2796856-ba32-4f63-9d78-a4fcfaff24ab" released by "delete_volume" :: held 0.811s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Created reservations ['46e86fdc-a274-469b-96a6-529d103e03a3', '769d3490-ed99-41b3-b6c9-b5db52893989', '68002e2f-6ca8-4544-881e-87c619db638f', '819d0200-532c-431f-9bde-fe225e07a1c4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:31:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Deleted volume successfully. Sep 16 13:31:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d1834539-e30f-453b-867a-c43a2b492ecf tempest-VolumesNegativeTest-479040604 None] Lock "cinder-d2796856-ba32-4f63-9d78-a4fcfaff24ab-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Flow 'volume_create_manager' (212bdda8-6e31-4fbd-bfed-cdf36d10260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffffd485-ddda-4748-b487-b1d7ed8b1042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffffd485-ddda-4748-b487-b1d7ed8b1042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1956050281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2391df-7d02-4456-98cd-4f11d468dc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f890c59234e97b3ba42c069f75496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:36Z,use_quota=True,user_id='3a61b3c639e84453a05fe80d30e3e84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d5c6d-cb06-4ad9-bb2a-cb851ce1a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d5c6d-cb06-4ad9-bb2a-cb851ce1a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7f8c90-6a09-4c98-8c07-6ee697bbbb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7f8c90-6a09-4c98-8c07-6ee697bbbb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2391df-7d02-4456-98cd-4f11d468dc0a', 'volume_name': 'volume-7d2391df-7d02-4456-98cd-4f11d468dc0a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8870b66-3505-4b74-835f-2e561a2915b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8870b66-3505-4b74-835f-2e561a2915b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813415e7-75fd-42a8-b38c-68da0bc4d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:36 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume 7d2391df-7d02-4456-98cd-4f11d468dc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2391df-7d02-4456-98cd-4f11d468dc0a', 'volume_size': 1} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1956050281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2391df-7d02-4456-98cd-4f11d468dc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f890c59234e97b3ba42c069f75496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:36Z,use_quota=True,user_id='3a61b3c639e84453a05fe80d30e3e84b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Creating volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:31:36 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:36 devstack quobyte-client[83541]: System call of process 100152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:36 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=117, name=volume-7d2391df-7d02-4456-98cd-4f11d468dc0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a 1073741824" returned: 0 in 0.421s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] <== create_volume: return (619ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:31:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813415e7-75fd-42a8-b38c-68da0bc4d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2391df-7d02-4456-98cd-4f11d468dc0a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba5a314-b0d7-488f-9a10-cf09e0dcd26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume volume-7d2391df-7d02-4456-98cd-4f11d468dc0a (7d2391df-7d02-4456-98cd-4f11d468dc0a): created successfully Sep 16 13:31:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba5a314-b0d7-488f-9a10-cf09e0dcd26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Flow 'volume_create_manager' (212bdda8-6e31-4fbd-bfed-cdf36d10260c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:31:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-88388f24-c8eb-42e7-8940-c134acadfbab tempest-VolumesSnapshotListTestJSON-1852289511 None] Created volume successfully. Sep 16 13:31:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Creating offline snapshot 1f8292d9-1ccd-475b-8934-e015411af509 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:31:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[570a4791-db31-4bb2-b0bf-de82b63ac050]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a" returned: 0 in 0.755s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=118, name=volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 1G" returned: 0 in 0.371s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:40 devstack quobyte-client[83541]: System call of process 100167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.245s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.181s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.157s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.info" returned: 0 in 0.361s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.223s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.info" returned: 0 in 0.240s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:41 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9f026603-ad45-4448-99db-d23b59abc711 tempest-VolumesSnapshotListTestJSON-1852289511 None] Create snapshot completed successfully Sep 16 13:31:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Creating offline snapshot a6a4f601-161d-4dd4-a329-9937e15d0c45 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:31:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5148b8e-e68d-45d0-8b83-9e3307b3eed2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.598s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:43 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=120, name=volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 1G" returned: 0 in 0.362s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:43 devstack quobyte-client[83541]: System call of process 100181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.183s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.118s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.695s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-47130588-fd70-4e87-8a7c-cffd43c37db2 tempest-VolumesSnapshotListTestJSON-1852289511 None] Create snapshot completed successfully Sep 16 13:31:45 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Creating offline snapshot 8123a363-2541-4882-904a-5d3eb3aaf7d0 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[951694d3-2157-4551-91da-1fd7a131c881]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.438s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:46 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=121, name=volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 1G" returned: 0 in 0.342s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img rebase -u -b volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.170s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.531s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3b0498a2-8562-44ba-aa20-a4002ae9715a tempest-VolumesSnapshotListTestJSON-1852289511 None] Create snapshot completed successfully Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-8123a363-2541-4882-904a-5d3eb3aaf7d0-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-8123a363-2541-4882-904a-5d3eb3aaf7d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-8123a363-2541-4882-904a-5d3eb3aaf7d0" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-8123a363-2541-4882-904a-5d3eb3aaf7d0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Deleting offline snapshot 8123a363-2541-4882-904a-5d3eb3aaf7d0 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] snapshot_file for this snap is: volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6975626b-f7fa-4b30-98b1-a6858564ad95]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.446s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7674a04-efe8-47dc-8b7e-cda2186ea0d6]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.508s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:51 devstack quobyte-client[83541]: System call of process 100205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:51 devstack quobyte-client[83541]: System call of process 100205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.432s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.8123a363-2541-4882-904a-5d3eb3aaf7d0" returned: 0 in 0.133s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-8123a363-2541-4882-904a-5d3eb3aaf7d0" released by "_delete_snapshot" :: held 1.863s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" released by "delete_snapshot" :: held 1.892s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:52 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Created reservations ['0453879f-7401-4186-a6e8-47451d39cfd9', 'b5ffbd9c-0906-4161-8763-a15d407ac27a', '2bb12abc-3965-46b4-bc63-87861c0f6247', 'f792a0af-c32b-40e2-919b-5e900a410d4f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:31:52 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Delete snapshot completed successfully. Sep 16 13:31:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9060545b-060b-422b-b05b-ac5a7178eac3 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-8123a363-2541-4882-904a-5d3eb3aaf7d0-delete_snapshot" released by "delete_snapshot" :: held 2.510s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-a6a4f601-161d-4dd4-a329-9937e15d0c45-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-a6a4f601-161d-4dd4-a329-9937e15d0c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:53 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-a6a4f601-161d-4dd4-a329-9937e15d0c45" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-a6a4f601-161d-4dd4-a329-9937e15d0c45" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Deleting offline snapshot a6a4f601-161d-4dd4-a329-9937e15d0c45 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] snapshot_file for this snap is: volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a7cfce-5abc-4bc0-bfb6-2bc2c0a63ca7]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:53 devstack quobyte-client[83541]: System call of process 100209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.535s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d07a1fb-ef82-443c-9cd9-57f3e691a02b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.546s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.302s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.a6a4f601-161d-4dd4-a329-9937e15d0c45" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-a6a4f601-161d-4dd4-a329-9937e15d0c45" released by "_delete_snapshot" :: held 1.930s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" released by "delete_snapshot" :: held 1.962s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:55 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Created reservations ['51ccdd4b-27dc-4877-ab6b-977cc18464b6', '90d02d18-e101-443a-8958-e7a948b55ca1', '168449e5-cda6-4fe7-97e9-ed7135b727a1', '4bf69063-d835-4b3c-9015-44594fa0432c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:31:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Delete snapshot completed successfully. Sep 16 13:31:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-84b56aef-575e-404c-99ad-8d9da4f92c4a tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-a6a4f601-161d-4dd4-a329-9937e15d0c45-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-1f8292d9-1ccd-475b-8934-e015411af509-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-1f8292d9-1ccd-475b-8934-e015411af509-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-1f8292d9-1ccd-475b-8934-e015411af509" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-1f8292d9-1ccd-475b-8934-e015411af509" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Deleting offline snapshot 1f8292d9-1ccd-475b-8934-e015411af509 of volume 7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] snapshot_file for this snap is: volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[59563e4e-4fd1-4f23-8fd2-39180f637284]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.468s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d2391df-7d02-4456-98cd-4f11d468dc0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf60a1a-d188-4106-a8e9-fd9c6baaadcf]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a" returned: 0 in 0.689s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Flow 'volume_create_manager' (d326812d-18f6-4f79-8a26-3e6b2c488eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c3ddb-eee5-43b0-a2eb-545e16b34a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 0.811s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:31:58 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Flow 'volume_create_manager' (9f22d662-ecaa-4078-be5e-52f61c9041e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f8f9c3-a62a-4b1c-85a6-24211197bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9c3ddb-eee5-43b0-a2eb-545e16b34a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-402178832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aacc4c1-3099-4230-833b-c163d5bb0539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932af47155043a98c23110aeaca0dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:57Z,use_quota=True,user_id='facd62292518468fa0147809da87eacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998efa1b-fc8a-45f9-96c7-4d5ee62c683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998efa1b-fc8a-45f9-96c7-4d5ee62c683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7943dd-2107-4d18-b3b0-742d5616ddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7943dd-2107-4d18-b3b0-742d5616ddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aacc4c1-3099-4230-833b-c163d5bb0539', 'volume_name': 'volume-5aacc4c1-3099-4230-833b-c163d5bb0539', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e875d2bc-d383-42ab-97a3-317d9ab0325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e875d2bc-d383-42ab-97a3-317d9ab0325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4489ff2e-bf0e-49e8-ad3e-2c9766426952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume 5aacc4c1-3099-4230-833b-c163d5bb0539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aacc4c1-3099-4230-833b-c163d5bb0539', 'volume_size': 1} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-402178832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aacc4c1-3099-4230-833b-c163d5bb0539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932af47155043a98c23110aeaca0dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:57Z,use_quota=True,user_id='facd62292518468fa0147809da87eacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Creating volume 5aacc4c1-3099-4230-833b-c163d5bb0539 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:31:59 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:31:59 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=122, name=volume-5aacc4c1-3099-4230-833b-c163d5bb0539, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f8f9c3-a62a-4b1c-85a6-24211197bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928646022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca4be7-b976-43bd-a252-911168e3666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932af47155043a98c23110aeaca0dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:58Z,use_quota=True,user_id='facd62292518468fa0147809da87eacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784823fc-9594-413a-ac3b-2382cd90a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784823fc-9594-413a-ac3b-2382cd90a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5d8434-de09-4523-b234-a5ac2920698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5d8434-de09-4523-b234-a5ac2920698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ca4be7-b976-43bd-a252-911168e3666a', 'volume_name': 'volume-32ca4be7-b976-43bd-a252-911168e3666a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb9982-1b3b-4c66-a2bc-f4a90468e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb9982-1b3b-4c66-a2bc-f4a90468e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994a79fa-ee7e-4509-862d-e71e1bafd951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:31:59 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume 32ca4be7-b976-43bd-a252-911168e3666a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ca4be7-b976-43bd-a252-911168e3666a', 'volume_size': 1} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:31:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a.1f8292d9-1ccd-475b-8934-e015411af509" returned: 0 in 1.314s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 1073741824" returned: 0 in 0.697s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-1f8292d9-1ccd-475b-8934-e015411af509" released by "_delete_snapshot" :: held 3.813s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" released by "delete_snapshot" :: held 4.001s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539" returned: 0 in 0.587s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] <== create_volume: return (1325ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1928646022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca4be7-b976-43bd-a252-911168e3666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932af47155043a98c23110aeaca0dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:31:58Z,use_quota=True,user_id='facd62292518468fa0147809da87eacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Creating volume 32ca4be7-b976-43bd-a252-911168e3666a {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:00 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:00 devstack quobyte-client[83541]: System call of process 100234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:32:00 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=123, name=volume-32ca4be7-b976-43bd-a252-911168e3666a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4489ff2e-bf0e-49e8-ad3e-2c9766426952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aacc4c1-3099-4230-833b-c163d5bb0539', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25694d-8136-4f6c-a55e-a997ea344d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:01 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume volume-5aacc4c1-3099-4230-833b-c163d5bb0539 (5aacc4c1-3099-4230-833b-c163d5bb0539): created successfully Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25694d-8136-4f6c-a55e-a997ea344d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Flow 'volume_create_manager' (d326812d-18f6-4f79-8a26-3e6b2c488eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-caca426e-db42-423a-af63-618ead5d4dc9 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Created volume successfully. Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a 1073741824" returned: 0 in 0.579s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Created reservations ['e673cf41-0610-4fed-be32-d6657e0abd42', '7ee77aab-30fd-4eee-832d-0617a358179b', '349b19eb-5abe-4bbc-9bee-85bae013edda', '8dca18f6-4a8c-49f3-a812-c5df77967832'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a" returned: 0 in 0.470s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] <== create_volume: return (1071ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994a79fa-ee7e-4509-862d-e71e1bafd951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ca4be7-b976-43bd-a252-911168e3666a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e25c0d-676a-40e2-8562-eae0266d38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:01 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume volume-32ca4be7-b976-43bd-a252-911168e3666a (32ca4be7-b976-43bd-a252-911168e3666a): created successfully Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e25c0d-676a-40e2-8562-eae0266d38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:01 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Flow 'volume_create_manager' (9f22d662-ecaa-4078-be5e-52f61c9041e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-052c17df-84cc-478c-9c9a-b6c8488734d8 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Created volume successfully. Sep 16 13:32:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Delete snapshot completed successfully. Sep 16 13:32:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7e9fef61-18fd-4eed-a26e-e49817ee12b7 tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-1f8292d9-1ccd-475b-8934-e015411af509-delete_snapshot" released by "delete_snapshot" :: held 5.628s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-7d2391df-7d02-4456-98cd-4f11d468dc0a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-7d2391df-7d02-4456-98cd-4f11d468dc0a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf4433-25cc-48c9-8f55-d03c035e693f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a" returned: 0 in 0.449s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7d2391df-7d02-4456-98cd-4f11d468dc0a" returned: 0 in 0.127s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-quobyte-7d2391df-7d02-4456-98cd-4f11d468dc0a" released by "delete_volume" :: held 0.767s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Created reservations ['dde483f4-3d3c-4a21-8d20-860195674718', '50b1b115-b8a5-4760-a252-6e11015a01e4', '1e861d28-5f00-4c8f-be55-53ade1d82af1', '452d5716-2fb0-47b3-a384-b428d77e5be4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Deleted volume successfully. Sep 16 13:32:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b9ba2a46-e23d-4327-b5c7-2d718fff58da tempest-VolumesSnapshotListTestJSON-1852289511 None] Lock "cinder-7d2391df-7d02-4456-98cd-4f11d468dc0a-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:08 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (2e346a47-0f55-4d73-94c7-e672a98a9090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34b7b1e-89a0-4e6d-a7a0-3b69cfe3af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34b7b1e-89a0-4e6d-a7a0-3b69cfe3af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f571e12-c138-4b9f-8148-5c0e6d9ef601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:09Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b35c7-5755-4eff-907c-0a0de5222b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b35c7-5755-4eff-907c-0a0de5222b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c612086a-7e21-4b95-9c61-9983b9689eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c612086a-7e21-4b95-9c61-9983b9689eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f571e12-c138-4b9f-8148-5c0e6d9ef601', 'volume_name': 'volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ed2b5e-a258-4362-978b-c7662ea84aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ed2b5e-a258-4362-978b-c7662ea84aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d6117b-6cc1-479c-9ae1-9f1c7a7cb39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:08 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume 4f571e12-c138-4b9f-8148-5c0e6d9ef601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601', 'volume_size': 1} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f571e12-c138-4b9f-8148-5c0e6d9ef601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:09Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume 4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:08 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:09 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:09 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=124, name=volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 1073741824" returned: 0 in 0.369s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601" returned: 0 in 0.100s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d6117b-6cc1-479c-9ae1-9f1c7a7cb39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a4aff6-580c-4262-a98f-4dd759b5e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:09 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 (4f571e12-c138-4b9f-8148-5c0e6d9ef601): created successfully Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a4aff6-580c-4262-a98f-4dd759b5e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:09 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (2e346a47-0f55-4d73-94c7-e672a98a9090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d9e7b22c-4ca9-4673-985d-b2b3b07cf47d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:11 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating offline snapshot 873b91e1-946b-4a1c-ba9b-29aab02be975 of volume 4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[51de08c9-70a5-4003-98b2-95d309975283]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601" returned: 0 in 0.459s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:12 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=125, name=volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 1G" returned: 0 in 0.327s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img rebase -u -b volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.294s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:32:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.183s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.info" returned: 0 in 0.161s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.info" returned: 0 in 0.456s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:14 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-296cc6c7-65e8-4515-bf98-f442cba97ecb tempest-CreateVolumesFromSnapshotTest-1533246898 None] Create snapshot completed successfully Sep 16 13:32:16 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (6735905c-5958-4f7f-b359-5d19112777a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18fac54-424d-42e7-9c71-aa9b1fb8ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18fac54-424d-42e7-9c71-aa9b1fb8ccae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371847470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3b4c71-9a02-490b-80da-dec1b9b04015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:16Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fc7eaf-2645-4c1c-9641-a4948a3406f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fc7eaf-2645-4c1c-9641-a4948a3406f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a0af6f-5c2d-4d93-baaa-a06ca30b94be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a0af6f-5c2d-4d93-baaa-a06ca30b94be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3b4c71-9a02-490b-80da-dec1b9b04015', 'volume_name': 'volume-cb3b4c71-9a02-490b-80da-dec1b9b04015', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab354f77-8793-469e-8cf3-df9417f1bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab354f77-8793-469e-8cf3-df9417f1bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2986e015-efa2-4575-aaa3-7b74eca482e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:16 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume cb3b4c71-9a02-490b-80da-dec1b9b04015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3b4c71-9a02-490b-80da-dec1b9b04015', 'volume_size': 1} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371847470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3b4c71-9a02-490b-80da-dec1b9b04015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:16Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume cb3b4c71-9a02-490b-80da-dec1b9b04015 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:16 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:17 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=127, name=volume-cb3b4c71-9a02-490b-80da-dec1b9b04015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (8a64dde7-7740-4933-8d2f-cb135d8b0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f580ad-53ea-42f4-bbcd-1856b3d7e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 1073741824" returned: 0 in 0.870s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (c58dc49f-f22e-45e9-9081-cdc3b93ce56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc6083f-61c9-4820-98f6-0c619397508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc6083f-61c9-4820-98f6-0c619397508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806072638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c81c6e1-4ec5-4f93-8a1a-9b141b82e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:17Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d081a5-b08f-4a8a-8057-7819ca329c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d081a5-b08f-4a8a-8057-7819ca329c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8b1395-4e51-4fcc-84b7-edd8f81ac50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8b1395-4e51-4fcc-84b7-edd8f81ac50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c81c6e1-4ec5-4f93-8a1a-9b141b82e569', 'volume_name': 'volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad0580-4129-4061-aa3d-f7e2f87da241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ad0580-4129-4061-aa3d-f7e2f87da241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8becc334-3dd0-4090-825c-d4903dc70295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume 7c81c6e1-4ec5-4f93-8a1a-9b141b82e569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569', 'volume_size': 1} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f580ad-53ea-42f4-bbcd-1856b3d7e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024680104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfac17d0-ce91-4835-b837-a15267e6829a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:17Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac8185a-b3ea-4c91-95d5-edf9320b10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac8185a-b3ea-4c91-95d5-edf9320b10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48878b06-00ba-45da-9201-6547c252fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48878b06-00ba-45da-9201-6547c252fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfac17d0-ce91-4835-b837-a15267e6829a', 'volume_name': 'volume-dfac17d0-ce91-4835-b837-a15267e6829a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c27bf9-02c6-4f96-95cc-711ee79a858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c27bf9-02c6-4f96-95cc-711ee79a858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b195a01-0c4a-4413-aaea-d576a1fe5b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:18 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume dfac17d0-ce91-4835-b837-a15267e6829a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfac17d0-ce91-4835-b837-a15267e6829a', 'volume_size': 1} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015" returned: 0 in 0.693s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (1643ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806072638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c81c6e1-4ec5-4f93-8a1a-9b141b82e569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:17Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume 7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:18 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:18 devstack quobyte-client[83541]: System call of process 100320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:32:18 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=128, name=volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2986e015-efa2-4575-aaa3-7b74eca482e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3b4c71-9a02-490b-80da-dec1b9b04015', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:18 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47de5c9a-2d80-4dc6-aadb-0db0872fdff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (8f24a7ba-adbf-4b6e-be87-c604279c79b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71339ddb-10af-4127-9167-03605a400111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71339ddb-10af-4127-9167-03605a400111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661100348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c89ee1b-85fa-4c38-9e88-a628b26a42d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:18Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc924d55-b49b-48e9-991e-732225b4d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc924d55-b49b-48e9-991e-732225b4d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09759bb-0227-40fb-a7e7-be833aa74977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09759bb-0227-40fb-a7e7-be833aa74977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c89ee1b-85fa-4c38-9e88-a628b26a42d9', 'volume_name': 'volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d1e127-7ea9-479e-be6a-39d1e1e6a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d1e127-7ea9-479e-be6a-39d1e1e6a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8646c66-834c-4413-a989-74ffe4e53604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume 8c89ee1b-85fa-4c38-9e88-a628b26a42d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9', 'volume_size': 1} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 (cb3b4c71-9a02-490b-80da-dec1b9b04015): created successfully Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47de5c9a-2d80-4dc6-aadb-0db0872fdff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (6735905c-5958-4f7f-b359-5d19112777a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 1073741824" returned: 0 in 0.810s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (0921f905-20b6-4b2c-899d-8eb27b3f37f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1778745f-7d22-4a24-baca-9afe953a4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-97ac76b7-fb9f-456a-8f8c-d99e320aa58c tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1778745f-7d22-4a24-baca-9afe953a4329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-308974048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed22069-109b-443d-905f-d1f63312bb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:18Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2964255-8ec9-459a-937d-daf0fa7b0575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2964255-8ec9-459a-937d-daf0fa7b0575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773eafa-23b0-461f-a5aa-d9b59271c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1773eafa-23b0-461f-a5aa-d9b59271c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed22069-109b-443d-905f-d1f63312bb43', 'volume_name': 'volume-7ed22069-109b-443d-905f-d1f63312bb43', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f403c18a-d10f-4cd1-ad0f-1c99734c42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f403c18a-d10f-4cd1-ad0f-1c99734c42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b78a1d-99b2-491e-87bc-5737a8314e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:19 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume 7ed22069-109b-443d-905f-d1f63312bb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed22069-109b-443d-905f-d1f63312bb43', 'volume_size': 1} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" returned: 0 in 0.546s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (1376ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024680104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfac17d0-ce91-4835-b837-a15267e6829a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:17Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume dfac17d0-ce91-4835-b837-a15267e6829a {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:19 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:19 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=129, name=volume-dfac17d0-ce91-4835-b837-a15267e6829a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8becc334-3dd0-4090-825c-d4903dc70295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ab2045-87cf-49c4-aa75-1aa968721da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a 1073741824" returned: 0 in 0.451s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:20 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 (7c81c6e1-4ec5-4f93-8a1a-9b141b82e569): created successfully Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ab2045-87cf-49c4-aa75-1aa968721da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (c58dc49f-f22e-45e9-9081-cdc3b93ce56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bba92639-a1c0-465f-a01f-8b7ff4b7172f tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a" returned: 0 in 0.331s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661100348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c89ee1b-85fa-4c38-9e88-a628b26a42d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:18Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume 8c89ee1b-85fa-4c38-9e88-a628b26a42d9 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:20 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:20 devstack quobyte-client[83541]: System call of process 100331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:32:20 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=130, name=volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b195a01-0c4a-4413-aaea-d576a1fe5b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfac17d0-ce91-4835-b837-a15267e6829a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:20 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddc9249-e127-4e37-9cd0-3eba53dd264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:21 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-dfac17d0-ce91-4835-b837-a15267e6829a (dfac17d0-ce91-4835-b837-a15267e6829a): created successfully Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddc9249-e127-4e37-9cd0-3eba53dd264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (8a64dde7-7740-4933-8d2f-cb135d8b0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 1073741824" returned: 0 in 0.422s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-91c831fc-edc5-4201-8a70-dfb5df8b9277 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" returned: 0 in 0.244s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-308974048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed22069-109b-443d-905f-d1f63312bb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7342b8da78384039924f25a19ca982dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:18Z,use_quota=True,user_id='d99cc2559d144f7386616d78066637ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Creating volume 7ed22069-109b-443d-905f-d1f63312bb43 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:32:21 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:21 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=131, name=volume-7ed22069-109b-443d-905f-d1f63312bb43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:32:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8646c66-834c-4413-a989-74ffe4e53604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc052ae-7927-4b36-841d-b02e9642ab13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43 1073741824" returned: 0 in 0.635s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 (8c89ee1b-85fa-4c38-9e88-a628b26a42d9): created successfully Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc052ae-7927-4b36-841d-b02e9642ab13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (8f24a7ba-adbf-4b6e-be87-c604279c79b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a5ff7dfe-6974-405b-9729-722d23e89908 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43" returned: 0 in 0.437s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b78a1d-99b2-491e-87bc-5737a8314e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed22069-109b-443d-905f-d1f63312bb43', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a34c79-b3e7-4328-9630-2bc354f31919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:22 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume volume-7ed22069-109b-443d-905f-d1f63312bb43 (7ed22069-109b-443d-905f-d1f63312bb43): created successfully Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a34c79-b3e7-4328-9630-2bc354f31919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:22 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Flow 'volume_create_manager' (0921f905-20b6-4b2c-899d-8eb27b3f37f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:22 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-aef10c1f-50c0-431c-ba67-0285a074166d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created volume successfully. Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-7ed22069-109b-443d-905f-d1f63312bb43-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-7ed22069-109b-443d-905f-d1f63312bb43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:23 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-7ed22069-109b-443d-905f-d1f63312bb43" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-7ed22069-109b-443d-905f-d1f63312bb43" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8857f7-8d80-4088-8e01-da32da3524b0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43" returned: 0 in 0.469s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:24 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7ed22069-109b-443d-905f-d1f63312bb43" returned: 0 in 0.546s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:24 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-7ed22069-109b-443d-905f-d1f63312bb43" released by "delete_volume" :: held 1.260s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=41,cinder:INSERT=14,cinder:UPDATE=53,cinder:DELETE=6 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=57,cinder:SELECT=40,cinder:INSERT=6,cinder:DELETE=9 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['cebeb7df-1d49-46a9-af58-1c0eca4313ad', '3c7c5f81-4240-45d8-a0f2-185416cf9526', '1cbf909d-857f-493f-9dc5-2f70b393ab21', '94a6f7b3-f1f2-4c61-8ce8-37a12a05093e'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:25 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:26 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.358s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:26 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:26 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:26 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-475a0825-3680-464c-b817-962b2477555d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-7ed22069-109b-443d-905f-d1f63312bb43-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-8c89ee1b-85fa-4c38-9e88-a628b26a42d9-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-8c89ee1b-85fa-4c38-9e88-a628b26a42d9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7bb53a-fa03-49f5-9df1-166c948bd542]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" returned: 0 in 0.653s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" returned: 0 in 0.147s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:28 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-8c89ee1b-85fa-4c38-9e88-a628b26a42d9" released by "delete_volume" :: held 1.211s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:28 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['1068f696-0a4a-45fd-a4fd-188334a8ae95', 'a167c6b7-daf7-4886-ad57-ccaa0e92efc0', '22f80422-1e50-4555-9616-daa626278ec8', 'fd8b0378-9172-4fd6-81ca-8e6a4dd221d6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.159s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:29 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:29 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-090635d2-9d39-4e01-9a68-1f7b02ca323d tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-8c89ee1b-85fa-4c38-9e88-a628b26a42d9-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5fb98d-f49a-4ad2-a8a1-dc990f4b6400]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" returned: 0 in 0.422s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" returned: 0 in 0.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569" released by "delete_volume" :: held 0.706s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['2f86299f-5d13-422d-920d-b47a17d93d46', 'a58f0a64-cf95-46ee-a5d9-f00ae38adfa9', '2fbf298c-de15-4e6f-8f90-b71d3496334e', '4af68ddd-1b43-46c8-8517-1b41bd6d9f58'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:31 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3218e571-4c61-464c-8b8d-a3df5ba8a91e tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-7c81c6e1-4ec5-4f93-8a1a-9b141b82e569-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-dfac17d0-ce91-4835-b837-a15267e6829a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-dfac17d0-ce91-4835-b837-a15267e6829a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-dfac17d0-ce91-4835-b837-a15267e6829a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-dfac17d0-ce91-4835-b837-a15267e6829a" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea579f-a32f-4422-837d-8aedcc163822]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a" returned: 0 in 0.501s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-dfac17d0-ce91-4835-b837-a15267e6829a" returned: 0 in 0.094s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-dfac17d0-ce91-4835-b837-a15267e6829a" released by "delete_volume" :: held 0.789s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['02ed6ceb-f572-4fc4-8943-91c8a931d06e', 'd8af7626-d3a7-4362-90a5-953701cab227', 'd22db119-710c-47bd-857b-248954258c16', 'e5773e02-39fd-452f-a8cf-cc4dbf91ff31'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:33 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:33 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fe847b47-a8a3-4462-b4a8-62e53a62c415 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-dfac17d0-ce91-4835-b837-a15267e6829a-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-cb3b4c71-9a02-490b-80da-dec1b9b04015-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-cb3b4c71-9a02-490b-80da-dec1b9b04015-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-cb3b4c71-9a02-490b-80da-dec1b9b04015" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-cb3b4c71-9a02-490b-80da-dec1b9b04015" acquired by "delete_volume" :: waited 0.018s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d545f6e-a6a8-43f9-915d-020c4283b018]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015" returned: 0 in 1.030s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-cb3b4c71-9a02-490b-80da-dec1b9b04015" returned: 0 in 0.182s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-cb3b4c71-9a02-490b-80da-dec1b9b04015" released by "delete_volume" :: held 1.441s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['d9ccf7aa-7c00-45ca-8f9f-f8c8c941672c', '2e9af667-2800-412c-b1aa-6baa051cdbd8', '573cb57b-7bca-477c-9bef-c94bcd950810', 'c8252dca-7b0e-47aa-b18a-5843af6cca53'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-873b91e1-946b-4a1c-ba9b-29aab02be975-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.489s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-873b91e1-946b-4a1c-ba9b-29aab02be975-delete_snapshot" acquired by "delete_snapshot" :: waited 0.175s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" acquired by "delete_snapshot" :: waited 0.218s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-873b91e1-946b-4a1c-ba9b-29aab02be975" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5cf35234-8143-4c61-9cfe-7d61154f4853 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-cb3b4c71-9a02-490b-80da-dec1b9b04015-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-873b91e1-946b-4a1c-ba9b-29aab02be975" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleting offline snapshot 873b91e1-946b-4a1c-ba9b-29aab02be975 of volume 4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] snapshot_file for this snap is: volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889aed3-ed4d-4c1c-88ee-ba992b757085]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.538s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:32:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7497a3-2752-431b-875c-61c41c1d617f]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601" returned: 0 in 0.574s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.320s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601.873b91e1-946b-4a1c-ba9b-29aab02be975" returned: 0 in 0.133s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-873b91e1-946b-4a1c-ba9b-29aab02be975" released by "_delete_snapshot" :: held 1.966s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" released by "delete_snapshot" :: held 2.027s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:40 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['04bdc59b-3edb-47ee-8113-b9681561caa2', '11c071da-3f35-4b24-af01-715436e4ddf0', '6ea75477-7568-4de6-8b8c-053b112b0b81', '2dad50c1-e7fe-4d64-9c72-9b600e076dc2'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:40 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Delete snapshot completed successfully. Sep 16 13:32:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f965f79e-fa2d-4c5f-9a10-450262c4ae07 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-873b91e1-946b-4a1c-ba9b-29aab02be975-delete_snapshot" released by "delete_snapshot" :: held 2.846s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.148s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-4f571e12-c138-4b9f-8148-5c0e6d9ef601-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-4f571e12-c138-4b9f-8148-5c0e6d9ef601-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d781333d-76da-446c-8a75-686bb7a24303]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601" returned: 0 in 0.563s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-4f571e12-c138-4b9f-8148-5c0e6d9ef601" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-quobyte-4f571e12-c138-4b9f-8148-5c0e6d9ef601" released by "delete_volume" :: held 0.839s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Created reservations ['e78871bf-d3a5-4fa2-9689-19ffe3a631e2', '494d0f3e-f892-4122-9353-acb558cb60e2', 'd62f5b3d-c1db-4ed6-b0b1-af0b9dc2e803', '36fe9201-b1b5-4180-89fc-4b86491be260'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.162s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:43 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:32:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Deleted volume successfully. Sep 16 13:32:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-3fb23d55-d4e1-4583-8d69-597bed769a82 tempest-CreateVolumesFromSnapshotTest-1533246898 None] Lock "cinder-4f571e12-c138-4b9f-8148-5c0e6d9ef601-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:32:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Flow 'volume_create_manager' (a2736ba7-7f23-4f68-a5dc-2bb899153a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185ac660-efc1-43f6-8135-58d88f5fa4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185ac660-efc1-43f6-8135-58d88f5fa4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28e956-303f-4b63-99e5-8b31d9bbfaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abedfd66111c4401b104a74ce9be7633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:51Z,use_quota=True,user_id='0483be16643d406387501df241b343e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c66898-af63-488a-8faa-5ef20ff28a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c66898-af63-488a-8faa-5ef20ff28a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39b50c4-7d3f-4159-9e7a-b8affcccacdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39b50c4-7d3f-4159-9e7a-b8affcccacdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a28e956-303f-4b63-99e5-8b31d9bbfaac', 'volume_name': 'volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac', 'volume_size': 1, 'image_id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a8ba53afcb8701dafc936fd2964210', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abedfd66111c4401b104a74ce9be7633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a16ba6fe6cf036873f7449da3a60f06add1290e4a85073f5c93bc5c168b80b9214ddd4c90bda1b696d15e1a3eff619f5334ce0ee8c62bac1264aa529c985c582', 'id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'created_at': datetime.datetime(2025, 9, 16, 11, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3066f07d-237d-4137-bca7-cd6d2a5d3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3066f07d-237d-4137-bca7-cd6d2a5d3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151ac310-51f2-4d0c-b30c-bc407fe9e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:32:51 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac', 'volume_size': 1, 'image_id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a8ba53afcb8701dafc936fd2964210', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abedfd66111c4401b104a74ce9be7633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a16ba6fe6cf036873f7449da3a60f06add1290e4a85073f5c93bc5c168b80b9214ddd4c90bda1b696d15e1a3eff619f5334ce0ee8c62bac1264aa529c985c582', 'id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'created_at': datetime.datetime(2025, 9, 16, 11, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c/file', 'properties': {}}, 'image_service': } Sep 16 13:32:51 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Cloning 2a28e956-303f-4b63-99e5-8b31d9bbfaac from image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:32:52 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:32:52 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Image download 0.00 MB at 0.00 MB/s Sep 16 13:32:52 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af916b7-17fb-410d-90af-810fc2ef4e57]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:52 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD Sep 16 13:32:52 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:32:54 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 16 13:32:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 0 in 2.275s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:54 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD Sep 16 13:32:54 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:32:56 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 16 13:32:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 1 in 2.246s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:32:56 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Temporary image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c is fetched for user 0483be16643d406387501df241b343e4. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:32:57 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161d946-004b-4bce-938e-3ce4d4f0d5f2]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:32:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:57 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD Sep 16 13:32:57 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:32:59 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 16 13:32:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 0 in 2.181s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:32:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:32:59 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD Sep 16 13:32:59 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:33:01 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 1 in 2.237s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28e956-303f-4b63-99e5-8b31d9bbfaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abedfd66111c4401b104a74ce9be7633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:32:51Z,use_quota=True,user_id='0483be16643d406387501df241b343e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Creating volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:33:01 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:01 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=50,cinder:SELECT=31,cinder:INSERT=10,cinder:DELETE=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:33:01 devstack quobyte-client[83541]: System call of process 100494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:01 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=132, name=volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac 1073741824" returned: 0 in 0.370s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 0 in 0.114s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.601s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Attempting download of 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c ((None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}])) to volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51d5f0-ad89-41c1-82ac-d6c7224b7ab9]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_92m8p22o {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_92m8p22o" returned: 0 in 0.356s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_92m8p22o {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_92m8p22o" returned: 1 in 0.423s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_92m8p22o' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d17b21-5aa8-4ea2-aac2-358f11d9b6ce]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c was raw, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:04 devstack quobyte-client[83541]: System call of process 100520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:04 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=132, name=volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 0 in 0.309s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ea76aeb-cb3e-4fe1-81f4-0c203b61015c_u2472b2udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:33:04 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 13:33:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac 1G" returned: 0 in 0.175s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:05 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea9ce1d-c01a-4346-be34-126b0619c37f]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:05 devstack quobyte-client[83541]: System call of process 100526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 0 in 0.408s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 1 in 0.445s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Downloaded image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c ((None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}])) to volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Temporary image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c for user 0483be16643d406387501df241b343e4 is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Marking volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Copying metadata from image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c to 2a28e956-303f-4b63-99e5-8b31d9bbfaac. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Creating volume glance metadata for volume 2a28e956-303f-4b63-99e5-8b31d9bbfaac backed by image 9ea76aeb-cb3e-4fe1-81f4-0c203b61015c with: {'image_id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f8a8ba53afcb8701dafc936fd2964210', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151ac310-51f2-4d0c-b30c-bc407fe9e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac', 'volume_size': 1, 'image_id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f8a8ba53afcb8701dafc936fd2964210', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abedfd66111c4401b104a74ce9be7633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a16ba6fe6cf036873f7449da3a60f06add1290e4a85073f5c93bc5c168b80b9214ddd4c90bda1b696d15e1a3eff619f5334ce0ee8c62bac1264aa529c985c582', 'id': '9ea76aeb-cb3e-4fe1-81f4-0c203b61015c', 'created_at': datetime.datetime(2025, 9, 16, 11, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ea76aeb-cb3e-4fe1-81f4-0c203b61015c/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b735655-eace-4f73-b145-3b99585be9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:06 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Volume volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac (2a28e956-303f-4b63-99e5-8b31d9bbfaac): created successfully Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b735655-eace-4f73-b145-3b99585be9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:06 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Flow 'volume_create_manager' (a2736ba7-7f23-4f68-a5dc-2bb899153a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:33:06 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e892f32b-e039-4827-b1c0-773b650a2c6a tempest-VolumeImageDependencyTests-2046575476 None] Created volume successfully. Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Acquiring lock "cinder-2a28e956-303f-4b63-99e5-8b31d9bbfaac-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "cinder-2a28e956-303f-4b63-99e5-8b31d9bbfaac-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Acquiring lock "cinder-quobyte-2a28e956-303f-4b63-99e5-8b31d9bbfaac" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "cinder-quobyte-2a28e956-303f-4b63-99e5-8b31d9bbfaac" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dc4986-66e9-49b6-adfe-418a2735e090]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 0 in 0.505s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:08 devstack quobyte-client[83541]: System call of process 100534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 1 in 0.542s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-2a28e956-303f-4b63-99e5-8b31d9bbfaac" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "cinder-quobyte-2a28e956-303f-4b63-99e5-8b31d9bbfaac" released by "delete_volume" :: held 1.424s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Created reservations ['da077184-3ba0-44d5-bbc2-f0ad217eb178', '95d2ffe5-57a7-480b-aa34-9cd6e9a90c30', '6269c70d-2ed7-48bf-91c0-726410475114', '4f0f5f23-bcf3-4735-ac67-a9f4a610d226'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.130s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:33:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Deleted volume successfully. Sep 16 13:33:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-33fc7135-9891-42bf-9488-6757b3fa53e5 tempest-VolumeImageDependencyTests-2046575476 None] Lock "cinder-2a28e956-303f-4b63-99e5-8b31d9bbfaac-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:19 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:33:24 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=48,cinder:INSERT=23,cinder:UPDATE=68,cinder:DELETE=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:33:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Flow 'volume_create_manager' (9594f37e-847b-4eb0-a0ca-410e8a82e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad54be77-55a2-44f3-9e1b-f76236864f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad54be77-55a2-44f3-9e1b-f76236864f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-297081474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d7ea7c-8aed-4aba-a990-e5d3c6118e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778cf135ba45d789d4b409c529a053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:33:38Z,use_quota=True,user_id='aef1e8b4ea1444209393807649823228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e76713-ff2e-4cd6-b342-48c44a571df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e76713-ff2e-4cd6-b342-48c44a571df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11355b0a-a054-42ef-97ae-a40f09f13375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11355b0a-a054-42ef-97ae-a40f09f13375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d7ea7c-8aed-4aba-a990-e5d3c6118e6b', 'volume_name': 'volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d70f10-64f3-4c64-81b3-049940e8140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d70f10-64f3-4c64-81b3-049940e8140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f59d4f9-bfb2-430a-a6f1-ca4ad445cbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Volume 04d7ea7c-8aed-4aba-a990-e5d3c6118e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b', 'volume_size': 1} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-297081474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d7ea7c-8aed-4aba-a990-e5d3c6118e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778cf135ba45d789d4b409c529a053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:33:38Z,use_quota=True,user_id='aef1e8b4ea1444209393807649823228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Creating volume 04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:33:38 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:38 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=133, name=volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b 1073741824" returned: 0 in 0.383s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.080s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] <== create_volume: return (528ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.540s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f59d4f9-bfb2-430a-a6f1-ca4ad445cbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeab68d0-bf6f-44d9-883f-9d72670821eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Volume volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b (04d7ea7c-8aed-4aba-a990-e5d3c6118e6b): created successfully Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeab68d0-bf6f-44d9-883f-9d72670821eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Flow 'volume_create_manager' (9594f37e-847b-4eb0-a0ca-410e8a82e525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:33:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-038d7114-ac35-4dde-b6ec-a0c5a2bfba81 tempest-SnapshotDependencyTests-185451239 None] Created volume successfully. Sep 16 13:33:40 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Creating offline snapshot 29c4a813-8128-4c74-958e-45cda56a01ca of volume 04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:33:40 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae0631b-2a73-445d-89cf-e359d6d9c389]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:41 devstack quobyte-client[83541]: System call of process 100613 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.805s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.334s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:33:41 devstack quobyte-client[83541]: System call of process 100618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:41 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=134, name=volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca 1G" returned: 0 in 0.416s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "qemu-img rebase -u -b volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.215s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.101s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.181s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.info" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.info" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:43 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-1725a4c0-c392-4937-a138-8319b75096a2 tempest-SnapshotDependencyTests-185451239 None] Create snapshot completed successfully Sep 16 13:33:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Flow 'volume_create_manager' (d8706bd9-a1b5-4ea7-8276-152bf0626a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d06e163-f50b-43f1-a09a-135572ceaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d06e163-f50b-43f1-a09a-135572ceaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847aec56-9932-4227-bb30-4a7b8042e19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3778cf135ba45d789d4b409c529a053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29c4a813-8128-4c74-958e-45cda56a01ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:33:44Z,use_quota=True,user_id='aef1e8b4ea1444209393807649823228',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef292e2d-96f9-49a3-bfb7-49bd9dc41171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef292e2d-96f9-49a3-bfb7-49bd9dc41171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964eebbf-4c36-4c2a-a560-b5d0e59983f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964eebbf-4c36-4c2a-a560-b5d0e59983f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '847aec56-9932-4227-bb30-4a7b8042e19a', 'volume_name': 'volume-847aec56-9932-4227-bb30-4a7b8042e19a', 'volume_size': 1, 'snapshot_id': '29c4a813-8128-4c74-958e-45cda56a01ca'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caadec4c-bb90-4183-a592-c7aeefaa36cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caadec4c-bb90-4183-a592-c7aeefaa36cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a72fe-643d-4207-9091-614bc49ac6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Volume 847aec56-9932-4227-bb30-4a7b8042e19a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-847aec56-9932-4227-bb30-4a7b8042e19a', 'volume_size': 1, 'snapshot_id': '29c4a813-8128-4c74-958e-45cda56a01ca'} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca-847aec56-9932-4227-bb30-4a7b8042e19a" by "_create_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca-847aec56-9932-4227-bb30-4a7b8042e19a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Creating volume 847aec56-9932-4227-bb30-4a7b8042e19a from snapshot 29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:359}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" by "_copy_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] snapshot: 29c4a813-8128-4c74-958e-45cda56a01ca, volume: 847aec56-9932-4227-bb30-4a7b8042e19a, {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:404}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfcc59e-faaa-456a-92f8-64d2e6c29b1a]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:45 devstack quobyte-client[83541]: System call of process 100635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.649s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Creating direct copy from snapshot {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[161ad2cf-f215-4b63-8346-6002d76ec71d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.672s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:46 devstack cinder-volume[83513]: DEBUG cinder.utils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a not found in is_blk_device check {{(pid=83513) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 13:33:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:33:46 devstack quobyte-client[83541]: System call of process 100649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:46 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=136, name=volume-847aec56-9932-4227-bb30-4a7b8042e19a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:33:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a" returned: 0 in 7.309s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e44c0-04d7-4513-a5c1-4f8aa1313199]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.552s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:33:54 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Converted 1024.00 MB image at 140.02 MB/s Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a" returned: 0 in 0.077s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" released by "_copy_volume_from_snapshot" :: held 9.688s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca-847aec56-9932-4227-bb30-4a7b8042e19a" released by "_create_volume_from_snapshot" :: held 9.729s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.753s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.084s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8698d-d124-4c12-b5c5-d7eca1bb6f71]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8a72fe-643d-4207-9091-614bc49ac6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847aec56-9932-4227-bb30-4a7b8042e19a', 'volume_size': 1, 'snapshot_id': '29c4a813-8128-4c74-958e-45cda56a01ca'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ec4bc0-4e3a-4366-b438-8ff99946fbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:33:55 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Volume volume-847aec56-9932-4227-bb30-4a7b8042e19a (847aec56-9932-4227-bb30-4a7b8042e19a): created successfully Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ec4bc0-4e3a-4366-b438-8ff99946fbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Flow 'volume_create_manager' (d8706bd9-a1b5-4ea7-8276-152bf0626a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:33:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7bcf21b9-2575-474c-aa46-0d6751d19a4d tempest-SnapshotDependencyTests-185451239 None] Created volume successfully. Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539" returned: 0 in 0.581s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.670s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:33:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-5aacc4c1-3099-4230-833b-c163d5bb0539', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '754cd413-eefb-48ec-aa22-3588a08ec3b8', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:33:55 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-ddc9eee0-7a86-4c6e-90f9-a3594156b520 req-55e6fe66-936b-43a2-a9ef-d867064eaadb tempest-TestServerVolumeAttachmentScenario-1955544903 None] attachment_update completed successfully. Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-29c4a813-8128-4c74-958e-45cda56a01ca-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-29c4a813-8128-4c74-958e-45cda56a01ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Deleting offline snapshot 29c4a813-8128-4c74-958e-45cda56a01ca of volume 04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] snapshot_file for this snap is: volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[955b4099-e06c-4508-af88-6e60658ffa72]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.547s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b1711-42af-4a06-a195-922655bd76be]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.415s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:57 devstack quobyte-client[83541]: System call of process 100882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.310s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b.29c4a813-8128-4c74-958e-45cda56a01ca" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-29c4a813-8128-4c74-958e-45cda56a01ca" released by "_delete_snapshot" :: held 1.747s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" released by "delete_snapshot" :: held 1.776s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:58 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Created reservations ['4196b317-03a2-42d7-a091-cdcc0833d34a', '0c29b412-7671-4de4-88f4-ad1d497d190b', '37d5eb00-78e5-46f7-b6db-a964d7a04257', '89f6f50d-be7b-4b18-bd69-0760fa6c9df6'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:33:58 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Delete snapshot completed successfully. Sep 16 13:33:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-ef9e8e07-1870-4193-a4bb-2aa3291b6819 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-29c4a813-8128-4c74-958e-45cda56a01ca-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:59 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a762d3-1ac3-423f-a836-b8a05ce75f37]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:33:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" returned: 0 in 0.136s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b" released by "delete_volume" :: held 0.715s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Created reservations ['19952c09-31c5-4ff3-a07a-e8aa140271ea', '426d1bcc-5fbd-4200-9d93-5536f1ee2365', '14f07775-d318-4c09-b656-b62848e2e3df', '3bcef05c-f6ea-4ad9-ab22-a9fef972fef0'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.083s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:34:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Deleted volume successfully. Sep 16 13:34:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bbe2cf01-e815-4d94-b869-30c4df4c7509 tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-04d7ea7c-8aed-4aba-a990-e5d3c6118e6b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:34:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-847aec56-9932-4227-bb30-4a7b8042e19a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:34:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-847aec56-9932-4227-bb30-4a7b8042e19a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:34:02 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa11a5-0608-4d21-8a46-d3bddba075e1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a" returned: 0 in 0.514s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-847aec56-9932-4227-bb30-4a7b8042e19a" returned: 0 in 0.085s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-quobyte-847aec56-9932-4227-bb30-4a7b8042e19a" released by "delete_volume" :: held 0.780s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Created reservations ['80058804-bd01-439f-817f-7c0951b36caf', 'cd0eaa4e-b259-435c-8532-4264fed1760c', '0f50ce62-e76d-462a-868b-d7d8a302186a', 'ccc1eb44-ce47-480e-826d-b3bad5b8748b'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.122s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:34:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Deleted volume successfully. Sep 16 13:34:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-bf52217c-ac4c-4e2d-b711-72ee776f96cd tempest-SnapshotDependencyTests-185451239 None] Lock "cinder-847aec56-9932-4227-bb30-4a7b8042e19a-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:34:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:34:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:34:09 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab23f272-dcf7-4a4d-bfd4-a467a10da77b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:34:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a" returned: 0 in 0.594s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.675s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:34:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0', 'name': 'volume-32ca4be7-b976-43bd-a252-911168e3666a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbc7aa9e-c14f-4cf5-81e7-c8084f02b701', 'enforce_multipath': True} {{(pid=83513) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 13:34:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:34:10 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-2cccfd52-665e-4ea2-ac86-3150d91894c7 req-2ea83c88-ab2a-45be-a1d6-ca3961b7d80c tempest-TestServerVolumeAttachmentScenario-1955544903 None] attachment_update completed successfully. Sep 16 13:34:20 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=38,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:34:20 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=32,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:34:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-47e7a0e3-2713-49c2-81bf-af51f707e8b2 req-4a5629cf-29b4-4046-903b-827b583d2641 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:34:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-47e7a0e3-2713-49c2-81bf-af51f707e8b2 req-4a5629cf-29b4-4046-903b-827b583d2641 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:34:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-47e7a0e3-2713-49c2-81bf-af51f707e8b2 req-4a5629cf-29b4-4046-903b-827b583d2641 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Terminate volume connection completed successfully. Sep 16 13:34:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-47e7a0e3-2713-49c2-81bf-af51f707e8b2 req-4a5629cf-29b4-4046-903b-827b583d2641 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Deleting attachment bbc7aa9e-c14f-4cf5-81e7-c8084f02b701. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.086s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:34:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:34:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:34:48 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:35:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-438caf01-2708-4a1c-b1de-3a4acae281f2 req-78041b23-561a-44fb-bfd7-4a15c8127ace tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [req-438caf01-2708-4a1c-b1de-3a4acae281f2 req-78041b23-561a-44fb-bfd7-4a15c8127ace tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [req-438caf01-2708-4a1c-b1de-3a4acae281f2 req-78041b23-561a-44fb-bfd7-4a15c8127ace tempest-TestServerVolumeAttachmentScenario-1955544903 None] Terminate volume connection completed successfully. Sep 16 13:35:03 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [req-438caf01-2708-4a1c-b1de-3a4acae281f2 req-78041b23-561a-44fb-bfd7-4a15c8127ace tempest-TestServerVolumeAttachmentScenario-1955544903 None] Deleting attachment 754cd413-eefb-48ec-aa22-3588a08ec3b8. {{(pid=83513) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 13:35:13 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=2 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "cinder-32ca4be7-b976-43bd-a252-911168e3666a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-32ca4be7-b976-43bd-a252-911168e3666a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "cinder-quobyte-32ca4be7-b976-43bd-a252-911168e3666a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-quobyte-32ca4be7-b976-43bd-a252-911168e3666a" acquired by "delete_volume" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5cf006-8d5f-4ff4-9ce2-a202815d5726]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a" returned: 0 in 0.435s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-32ca4be7-b976-43bd-a252-911168e3666a" returned: 0 in 0.100s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-quobyte-32ca4be7-b976-43bd-a252-911168e3666a" released by "delete_volume" :: held 0.700s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Created reservations ['cc75572b-15e9-459d-9bfe-5a5edac2fc67', 'a3a4938d-90cf-4cff-a683-3ec04b9cac6a', 'a78d1d31-9920-411a-b943-e149bde7bed7', '267a1513-49f8-44d6-8da3-a9728cbe4ea0'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.130s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:16 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:17 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Deleted volume successfully. Sep 16 13:35:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5679323e-7205-43df-9449-be4221f33165 tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-32ca4be7-b976-43bd-a252-911168e3666a-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "cinder-5aacc4c1-3099-4230-833b-c163d5bb0539-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-5aacc4c1-3099-4230-833b-c163d5bb0539-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "cinder-quobyte-5aacc4c1-3099-4230-833b-c163d5bb0539" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-quobyte-5aacc4c1-3099-4230-833b-c163d5bb0539" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e8fb1d-f414-4a5b-92a8-d2d359746705]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539" returned: 0 in 0.399s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-5aacc4c1-3099-4230-833b-c163d5bb0539" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-quobyte-5aacc4c1-3099-4230-833b-c163d5bb0539" released by "delete_volume" :: held 0.647s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:18 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Created reservations ['2bd2a022-c233-493d-a4f8-ff841b8300c4', 'c1029677-7935-44f2-b187-f49c7da2373b', '40768f3f-a82c-4025-838c-a2b5e889be25', '51f8654e-8c0f-4256-a21b-a6e22f7dbd12'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Deleted volume successfully. Sep 16 13:35:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0f805dd6-8491-479c-902d-faefab2cc53a tempest-TestServerVolumeAttachmentScenario-1955544903 None] Lock "cinder-5aacc4c1-3099-4230-833b-c163d5bb0539-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:29 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=11,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:35:29 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:35:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (051b227d-9c51-4cd2-ad06-65538ad739c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3434dd56-e85e-4056-aeb6-406b6b2ac508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3434dd56-e85e-4056-aeb6-406b6b2ac508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284439078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250f30d0-48e8-4923-b6a5-6c2884b2857b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:34Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4bcc48-ae7e-4d3b-a4d6-5b5c51d6d63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4bcc48-ae7e-4d3b-a4d6-5b5c51d6d63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d298f179-e2a3-43cd-bb4e-b3c69673c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d298f179-e2a3-43cd-bb4e-b3c69673c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '250f30d0-48e8-4923-b6a5-6c2884b2857b', 'volume_name': 'volume-250f30d0-48e8-4923-b6a5-6c2884b2857b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07c13f-ee5b-40d4-a105-86f602e7f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07c13f-ee5b-40d4-a105-86f602e7f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f522e7-2da0-4719-bf27-deda8d762e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Volume 250f30d0-48e8-4923-b6a5-6c2884b2857b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-250f30d0-48e8-4923-b6a5-6c2884b2857b', 'volume_size': 1} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284439078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=250f30d0-48e8-4923-b6a5-6c2884b2857b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:34Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Creating volume 250f30d0-48e8-4923-b6a5-6c2884b2857b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:34 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=137, name=volume-250f30d0-48e8-4923-b6a5-6c2884b2857b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b 1073741824" returned: 0 in 0.562s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:35 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (3c7bc5eb-a094-466a-bd01-7bcfab981f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a99d49-cb27-4bab-beb3-75ef2a5f0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a99d49-cb27-4bab-beb3-75ef2a5f0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833308589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586652df-1051-4b77-9bb4-c6d8f2f0d6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:35Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598e00dd-807f-4a20-8d70-0c1abac2256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598e00dd-807f-4a20-8d70-0c1abac2256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fefb228-1b96-4d30-8bc2-86e5a4d0d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fefb228-1b96-4d30-8bc2-86e5a4d0d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '586652df-1051-4b77-9bb4-c6d8f2f0d6c5', 'volume_name': 'volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f042ee-b701-4999-ae93-85b84ab7436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f042ee-b701-4999-ae93-85b84ab7436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9807269-3d9b-4114-8684-c65ffb0d6f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:35 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Volume 586652df-1051-4b77-9bb4-c6d8f2f0d6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5', 'volume_size': 1} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b" returned: 0 in 0.577s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] <== create_volume: return (1174ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833308589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586652df-1051-4b77-9bb4-c6d8f2f0d6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:35Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Creating volume 586652df-1051-4b77-9bb4-c6d8f2f0d6c5 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:36 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:36 devstack quobyte-client[83541]: System call of process 101303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:35:36 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=138, name=volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f522e7-2da0-4719-bf27-deda8d762e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-250f30d0-48e8-4923-b6a5-6c2884b2857b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ede2a4-fc66-42f7-aae7-bebd46dccc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (cb1846d9-129d-4384-9aec-e665c12f1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fcfa37-a73d-4da9-be30-314fa8a1d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (608de706-2677-49f2-a6b2-ab325f723d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe5b6f-fc87-43b0-8ba0-b301df616b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 1073741824" returned: 0 in 0.818s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Volume volume-250f30d0-48e8-4923-b6a5-6c2884b2857b (250f30d0-48e8-4923-b6a5-6c2884b2857b): created successfully Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ede2a4-fc66-42f7-aae7-bebd46dccc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (051b227d-9c51-4cd2-ad06-65538ad739c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (0a9c3a13-d58f-4305-adac-06ff5fa749d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9c71a6-79df-4875-bca2-e9c4bacab943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fcfa37-a73d-4da9-be30-314fa8a1d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047640464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c08eb-6c74-4ed8-a1ef-f90af3e01aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:36Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0755cf6-a48b-4462-bde7-c321e11c237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0755cf6-a48b-4462-bde7-c321e11c237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005fc130-a9ba-4b82-84a4-552a4921a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005fc130-a9ba-4b82-84a4-552a4921a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16c08eb-6c74-4ed8-a1ef-f90af3e01aee', 'volume_name': 'volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e312d70e-f8c4-4ad6-a6fe-8fce5383f591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e312d70e-f8c4-4ad6-a6fe-8fce5383f591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985eb00b-a0bd-46f3-be06-5eee6a2a864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Volume a16c08eb-6c74-4ed8-a1ef-f90af3e01aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee', 'volume_size': 1} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe5b6f-fc87-43b0-8ba0-b301df616b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162357260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447754e-dda9-4b53-ada3-500392a52ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:35Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9068547f-db1a-43e2-98c7-9a848fc0606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9068547f-db1a-43e2-98c7-9a848fc0606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d93150-2dee-462a-b195-651ad280ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d93150-2dee-462a-b195-651ad280ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b447754e-dda9-4b53-ada3-500392a52ffd', 'volume_name': 'volume-b447754e-dda9-4b53-ada3-500392a52ffd', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a4896-d844-48db-bbb8-90480af98f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a4896-d844-48db-bbb8-90480af98f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9175edd-2b87-420f-a5df-1ed7cc8a512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Volume b447754e-dda9-4b53-ada3-500392a52ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b447754e-dda9-4b53-ada3-500392a52ffd', 'volume_size': 1} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9c71a6-79df-4875-bca2-e9c4bacab943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-182699654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e77f4b-eff3-4b19-97cf-b0852a44d624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:36Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79352328-ca8c-468d-98ef-7462b4b695ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79352328-ca8c-468d-98ef-7462b4b695ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f8300b-7214-4942-99f4-61b7ab6fd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f8300b-7214-4942-99f4-61b7ab6fd431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e77f4b-eff3-4b19-97cf-b0852a44d624', 'volume_name': 'volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5595b5-6da8-45db-84ec-497410ddd2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5595b5-6da8-45db-84ec-497410ddd2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcbe9ee-d091-4f11-99ab-3976080dfe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Volume c9e77f4b-eff3-4b19-97cf-b0852a44d624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624', 'volume_size': 1} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-22e66d7e-f64a-4a29-8f93-5b5c69618b64 tempest-CreateVolumesFromImageTest-1206761646 None] Created volume successfully. Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" returned: 0 in 0.632s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] <== create_volume: return (1470ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047640464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16c08eb-6c74-4ed8-a1ef-f90af3e01aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:36Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Creating volume a16c08eb-6c74-4ed8-a1ef-f90af3e01aee {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:37 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=139, name=volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9807269-3d9b-4114-8684-c65ffb0d6f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418a0bd5-cf97-4300-93cf-a003444942c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Volume volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 (586652df-1051-4b77-9bb4-c6d8f2f0d6c5): created successfully Sep 16 13:35:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418a0bd5-cf97-4300-93cf-a003444942c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (3c7bc5eb-a094-466a-bd01-7bcfab981f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee 1073741824" returned: 0 in 0.477s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:38 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a81d47a8-fd17-45b3-9c94-bdec8f7090bf tempest-CreateVolumesFromImageTest-1206761646 None] Created volume successfully. Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" returned: 0 in 0.294s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] <== create_volume: return (810ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162357260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447754e-dda9-4b53-ada3-500392a52ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:35Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Creating volume b447754e-dda9-4b53-ada3-500392a52ffd {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:38 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:38 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=140, name=volume-b447754e-dda9-4b53-ada3-500392a52ffd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985eb00b-a0bd-46f3-be06-5eee6a2a864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69067b1-c614-4170-8d47-057e6f1a8c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Volume volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee (a16c08eb-6c74-4ed8-a1ef-f90af3e01aee): created successfully Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69067b1-c614-4170-8d47-057e6f1a8c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (cb1846d9-129d-4384-9aec-e665c12f1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd 1073741824" returned: 0 in 0.473s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-62989b02-ea66-4147-823d-dd26bed6ab3c tempest-CreateVolumesFromImageTest-1206761646 None] Created volume successfully. Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd" returned: 0 in 0.248s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] <== create_volume: return (747ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-182699654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e77f4b-eff3-4b19-97cf-b0852a44d624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b163e1b5e6d44deaa28c0be280b460b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:36Z,use_quota=True,user_id='afd6cde823a948248f4f4456fcc3ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Creating volume c9e77f4b-eff3-4b19-97cf-b0852a44d624 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:39 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:39 devstack quobyte-client[83541]: System call of process 101318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:35:39 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=141, name=volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9175edd-2b87-420f-a5df-1ed7cc8a512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b447754e-dda9-4b53-ada3-500392a52ffd', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c93f1f-405f-4b0d-a33a-f4d860e21f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:39 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Volume volume-b447754e-dda9-4b53-ada3-500392a52ffd (b447754e-dda9-4b53-ada3-500392a52ffd): created successfully Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c93f1f-405f-4b0d-a33a-f4d860e21f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (608de706-2677-49f2-a6b2-ab325f723d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 1073741824" returned: 0 in 0.454s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ae6525a0-bae5-4f39-bdf9-847943d78efa tempest-CreateVolumesFromImageTest-1206761646 None] Created volume successfully. Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624" returned: 0 in 0.252s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] <== create_volume: return (738ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcbe9ee-d091-4f11-99ab-3976080dfe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f995e1-2f2a-42f0-bcd3-1a706d00c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:40 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Volume volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 (c9e77f4b-eff3-4b19-97cf-b0852a44d624): created successfully Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f995e1-2f2a-42f0-bcd3-1a706d00c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Flow 'volume_create_manager' (0a9c3a13-d58f-4305-adac-06ff5fa749d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:40 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-40d4b6a2-716b-46ab-80ed-3fffae1e31b6 tempest-CreateVolumesFromImageTest-1206761646 None] Created volume successfully. Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-c9e77f4b-eff3-4b19-97cf-b0852a44d624-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-c9e77f4b-eff3-4b19-97cf-b0852a44d624-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:40 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-quobyte-c9e77f4b-eff3-4b19-97cf-b0852a44d624" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-c9e77f4b-eff3-4b19-97cf-b0852a44d624" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f1e23-f31a-4f35-94a9-67ea0a58aa58]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624" returned: 0 in 0.414s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-c9e77f4b-eff3-4b19-97cf-b0852a44d624" returned: 0 in 0.189s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-c9e77f4b-eff3-4b19-97cf-b0852a44d624" released by "delete_volume" :: held 0.783s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.324s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Created reservations ['4499e033-cf06-40ca-9979-2522330a8431', '2740f706-1397-4f8a-8acf-d4500167847c', '06745348-f029-4977-8631-1cf8e3c2edff', 'b8101554-e07e-44fe-93a6-a1e95fe4a465'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.084s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Deleted volume successfully. Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4e9070af-41f1-41a6-9bf1-e7a55a78e9a5 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-c9e77f4b-eff3-4b19-97cf-b0852a44d624-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-quobyte-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca204332-f3b0-4876-bb52-d6fccb043753]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" returned: 0 in 0.405s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee" released by "delete_volume" :: held 0.668s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:43 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Created reservations ['0f80167f-cdef-4927-ba60-79a0160a6757', '8c1a7d06-1933-48aa-b071-0679a61279e0', '256f84b1-1622-443b-9923-b1a95550fda2', 'ebf74587-88bb-4602-be4b-dd640e13dcd5'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Deleted volume successfully. Sep 16 13:35:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-673b4210-0c84-4064-adb5-be1ef80be387 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-a16c08eb-6c74-4ed8-a1ef-f90af3e01aee-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-b447754e-dda9-4b53-ada3-500392a52ffd-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-b447754e-dda9-4b53-ada3-500392a52ffd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:45 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-quobyte-b447754e-dda9-4b53-ada3-500392a52ffd" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-b447754e-dda9-4b53-ada3-500392a52ffd" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ba0ffb-495a-4806-8d5a-d4231a253e3e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd" returned: 0 in 0.432s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-b447754e-dda9-4b53-ada3-500392a52ffd" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-b447754e-dda9-4b53-ada3-500392a52ffd" released by "delete_volume" :: held 0.711s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Created reservations ['c8f901bf-8206-40ea-a6ec-33fdf38cba3e', 'ec9f786f-62d3-4447-b23d-9ce6678f594e', '90cf7d9d-4226-4234-acb8-208b03543e54', 'fe6a422f-4194-4daf-91c7-f50581123206'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Deleted volume successfully. Sep 16 13:35:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dcfec3b-8574-41d6-bef3-ba64c7866bf0 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-b447754e-dda9-4b53-ada3-500392a52ffd-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-586652df-1051-4b77-9bb4-c6d8f2f0d6c5-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-586652df-1051-4b77-9bb4-c6d8f2f0d6c5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-quobyte-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c844e1-89d2-4851-87c1-8e1f2a94e9ac]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" returned: 0 in 0.407s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" returned: 0 in 0.103s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-586652df-1051-4b77-9bb4-c6d8f2f0d6c5" released by "delete_volume" :: held 0.668s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Created reservations ['3cfad401-5eb3-4624-882e-45d0c135d251', '07e24710-e390-464d-8dae-823df6744cf5', 'ed57d95c-40f1-47c9-8e64-d2b4da2f5816', 'e3f1e816-7cf3-4d30-992e-aeb80413f77c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.110s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:48 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:48 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Deleted volume successfully. Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-5372389b-091b-404c-b0ae-1e3120c75ec9 tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-586652df-1051-4b77-9bb4-c6d8f2f0d6c5-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-250f30d0-48e8-4923-b6a5-6c2884b2857b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-250f30d0-48e8-4923-b6a5-6c2884b2857b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:49 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "cinder-quobyte-250f30d0-48e8-4923-b6a5-6c2884b2857b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-250f30d0-48e8-4923-b6a5-6c2884b2857b" acquired by "delete_volume" :: waited 0.010s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02a8c2-a755-445e-9da0-6954852239cc]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b" returned: 0 in 0.405s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-250f30d0-48e8-4923-b6a5-6c2884b2857b" returned: 0 in 0.111s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-quobyte-250f30d0-48e8-4923-b6a5-6c2884b2857b" released by "delete_volume" :: held 0.678s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Created reservations ['32e8fad8-2b50-4957-94be-b08a9f2a8c11', '4efddc6e-91eb-404c-94ea-4fde71e011b7', '3df433b0-46c0-44b5-94a4-f364eaf1e704', '669c29a6-01a8-4e79-9d0c-db194f130a28'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.100s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:35:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Deleted volume successfully. Sep 16 13:35:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-70bc07fc-cbda-40cc-8131-b0d22a4c306e tempest-CreateVolumesFromImageTest-1206761646 None] Lock "cinder-250f30d0-48e8-4923-b6a5-6c2884b2857b-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:35:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:54 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:54 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Flow 'volume_create_manager' (5d512d21-e03f-4a25-8bf1-b18cf0718e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a2130e-a317-4102-8b60-0d2f3bb7c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a2130e-a317-4102-8b60-0d2f3bb7c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b183d6-773a-4b9a-8855-3ad9018dc1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0da87818b8449dae162869acdfaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:55Z,use_quota=True,user_id='ac4de670482e428e98c57f3624046cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffd6d3-66ce-4e85-992f-9a5743ab6fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffd6d3-66ce-4e85-992f-9a5743ab6fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e9e435-ab34-4e0b-ad63-2b16ea7052cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e9e435-ab34-4e0b-ad63-2b16ea7052cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b183d6-773a-4b9a-8855-3ad9018dc1e9', 'volume_name': 'volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1726508-62bb-4118-9bae-e678b694a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1726508-62bb-4118-9bae-e678b694a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f5ebf2-82e3-49a5-96f4-0886e4133db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Volume 52b183d6-773a-4b9a-8855-3ad9018dc1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9', 'volume_size': 1} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b183d6-773a-4b9a-8855-3ad9018dc1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0da87818b8449dae162869acdfaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:55Z,use_quota=True,user_id='ac4de670482e428e98c57f3624046cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Creating volume 52b183d6-773a-4b9a-8855-3ad9018dc1e9 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:55 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:55 devstack quobyte-client[83541]: System call of process 101352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:35:55 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=142, name=volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 1073741824" returned: 0 in 0.399s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] <== create_volume: return (568ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f5ebf2-82e3-49a5-96f4-0886e4133db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7d60a0-d4e0-41ca-81e6-976de1a5c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:55 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Volume volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 (52b183d6-773a-4b9a-8855-3ad9018dc1e9): created successfully Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7d60a0-d4e0-41ca-81e6-976de1a5c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:55 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Flow 'volume_create_manager' (5d512d21-e03f-4a25-8bf1-b18cf0718e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:56 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-3b06708c-0fc8-42b9-8866-b5df11e48bc1 tempest-CinderUnicodeTest-1351561009 None] Created volume successfully. Sep 16 13:35:57 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Flow 'volume_create_manager' (4d105d9e-517c-49c8-82ce-69934ab36c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fc27d2-db35-4885-812c-b71490b4db07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fc27d2-db35-4885-812c-b71490b4db07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1312872992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9af0e-2a07-415c-8a05-241faa79be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0da87818b8449dae162869acdfaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:57Z,use_quota=True,user_id='ac4de670482e428e98c57f3624046cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523fca75-c785-4f92-ba11-4e43c9736779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523fca75-c785-4f92-ba11-4e43c9736779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039ac4cd-1706-42cd-b98b-2c453dfaebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039ac4cd-1706-42cd-b98b-2c453dfaebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b9af0e-2a07-415c-8a05-241faa79be1d', 'volume_name': 'volume-47b9af0e-2a07-415c-8a05-241faa79be1d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b05c92-7b97-44eb-97ed-d2e37b9265c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b05c92-7b97-44eb-97ed-d2e37b9265c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b73d0d-f389-4c15-b94e-c643be52faa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:57 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Volume 47b9af0e-2a07-415c-8a05-241faa79be1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b9af0e-2a07-415c-8a05-241faa79be1d', 'volume_size': 1} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:35:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1312872992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9af0e-2a07-415c-8a05-241faa79be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd0da87818b8449dae162869acdfaf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:35:57Z,use_quota=True,user_id='ac4de670482e428e98c57f3624046cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Creating volume 47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:35:57 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:35:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:57 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=143, name=volume-47b9af0e-2a07-415c-8a05-241faa79be1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d 1073741824" returned: 0 in 0.317s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d" returned: 0 in 0.096s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.498s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b73d0d-f389-4c15-b94e-c643be52faa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b9af0e-2a07-415c-8a05-241faa79be1d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e85c07-49c9-464e-b84a-c602586a3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:35:58 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Volume volume-47b9af0e-2a07-415c-8a05-241faa79be1d (47b9af0e-2a07-415c-8a05-241faa79be1d): created successfully Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e85c07-49c9-464e-b84a-c602586a3c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Flow 'volume_create_manager' (4d105d9e-517c-49c8-82ce-69934ab36c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:35:58 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-cc1ff71b-97d4-45ab-9c60-08aa1b3aa8c4 tempest-CinderUnicodeTest-1351561009 None] Created volume successfully. Sep 16 13:35:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Creating offline snapshot 1c1f8c2a-acce-49c5-970d-1eb58dfa658f of volume 47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ae1d3-7824-40c5-99c3-9d3905637dca]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:35:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d" returned: 0 in 0.388s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:59 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=144, name=volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f 1G" returned: 0 in 0.237s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): qemu-img rebase -u -b volume-47b9af0e-2a07-415c-8a05-241faa79be1d -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "qemu-img rebase -u -b volume-47b9af0e-2a07-415c-8a05-241faa79be1d -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.145s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.078s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:35:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.info" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.info" returned: 0 in 0.079s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.474s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f694fed8-3a6c-4e36-a8c8-5df3dad959d9 tempest-CinderUnicodeTest-1351561009 None] Create snapshot completed successfully Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-1c1f8c2a-acce-49c5-970d-1eb58dfa658f-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-1c1f8c2a-acce-49c5-970d-1eb58dfa658f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-quobyte-1c1f8c2a-acce-49c5-970d-1eb58dfa658f" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-1c1f8c2a-acce-49c5-970d-1eb58dfa658f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Deleting offline snapshot 1c1f8c2a-acce-49c5-970d-1eb58dfa658f of volume 47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] snapshot_file for this snap is: volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53887fe-bf89-4af1-83b0-23417a3586cd]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.408s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b9af0e-2a07-415c-8a05-241faa79be1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4fadeb-93d3-48af-82e0-eb7aeccfa4f3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d" returned: 0 in 0.406s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.231s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d.1c1f8c2a-acce-49c5-970d-1eb58dfa658f" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-1c1f8c2a-acce-49c5-970d-1eb58dfa658f" released by "_delete_snapshot" :: held 1.431s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" released by "delete_snapshot" :: held 1.456s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Created reservations ['7a21cfb9-9d67-44c2-ad16-f84244fa1ff1', 'd44ea524-3874-4750-af71-b307605aac9c', '5b5217ac-e4fe-45cb-a123-8c477d4be9e7', '5b957d65-0696-4b2f-aa57-0d324ef5704c'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Delete snapshot completed successfully. Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-25435480-164e-4168-8b74-8711d2ac5e3f tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-1c1f8c2a-acce-49c5-970d-1eb58dfa658f-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-47b9af0e-2a07-415c-8a05-241faa79be1d-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-47b9af0e-2a07-415c-8a05-241faa79be1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" acquired by "delete_volume" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[764872fb-5c53-4a70-95f7-6a3306a9b523]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d" returned: 0 in 0.395s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-47b9af0e-2a07-415c-8a05-241faa79be1d" returned: 0 in 0.127s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-47b9af0e-2a07-415c-8a05-241faa79be1d" released by "delete_volume" :: held 0.683s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Created reservations ['1695401e-9570-41a9-92c9-6cd11a2e3b2b', '24976e8e-9bf0-42b8-bda1-7405c70cee84', 'c0bc6449-be7b-4c67-aa76-a49490f77cab', '7676e6b3-a5aa-438b-af4f-cbd3ed20a108'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:04 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Deleted volume successfully. Sep 16 13:36:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-708533b6-de7f-41d6-b5b4-bebdc8228ae4 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-47b9af0e-2a07-415c-8a05-241faa79be1d-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-52b183d6-773a-4b9a-8855-3ad9018dc1e9-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-52b183d6-773a-4b9a-8855-3ad9018dc1e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:05 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "cinder-quobyte-52b183d6-773a-4b9a-8855-3ad9018dc1e9" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-52b183d6-773a-4b9a-8855-3ad9018dc1e9" acquired by "delete_volume" :: waited 0.010s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a3a172-c58c-47aa-a8ff-e722dfad3a74]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9" returned: 0 in 0.420s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-52b183d6-773a-4b9a-8855-3ad9018dc1e9" returned: 0 in 0.087s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-quobyte-52b183d6-773a-4b9a-8855-3ad9018dc1e9" released by "delete_volume" :: held 0.696s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Created reservations ['ee8c1f50-3ce6-449d-968c-155e20c958df', '0c167c4c-709c-442f-b833-b073e9713155', 'a96dd8e0-d038-4cea-9b27-bc084555138c', '9418fb55-7891-4151-b607-4e160544c2a8'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:07 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:07 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Deleted volume successfully. Sep 16 13:36:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-084c268d-ff37-420a-a96c-d5d6b0e0e446 tempest-CinderUnicodeTest-1351561009 None] Lock "cinder-52b183d6-773a-4b9a-8855-3ad9018dc1e9-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:16 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=48,cinder:UPDATE=97,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:36:17 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=56,cinder:SELECT=48,cinder:DELETE=10,cinder:INSERT=21 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:36:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (6e1c9a30-fb71-48c8-8289-b22f3557a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6fd0e1-0970-46ef-b31f-07ec18973b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6fd0e1-0970-46ef-b31f-07ec18973b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582532974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2697042-fb57-48ca-8b9c-3bb2b9dd9eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77952d-e170-421f-8b51-e9d22cc86b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77952d-e170-421f-8b51-e9d22cc86b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bd61a8-c07a-4e71-ae29-6f5a2c7142d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bd61a8-c07a-4e71-ae29-6f5a2c7142d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2697042-fb57-48ca-8b9c-3bb2b9dd9eca', 'volume_name': 'volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74569cf-7efc-4ca6-91c4-98a6b5898b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74569cf-7efc-4ca6-91c4-98a6b5898b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a8bc27-88e9-42bb-bed2-c2378e82ac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:27 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume e2697042-fb57-48ca-8b9c-3bb2b9dd9eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca', 'volume_size': 1} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582532974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2697042-fb57-48ca-8b9c-3bb2b9dd9eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:27 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:27 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:27 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:27 devstack quobyte-client[83541]: System call of process 101482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:27 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=146, name=volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (1d4ddac4-b615-4e43-9ef3-5e24eb82406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c212aea-50ea-461e-af2a-edd07e1d4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c212aea-50ea-461e-af2a-edd07e1d4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254801332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e09e9e-d933-4912-8523-c0f1315c3d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5882611c-773b-4f2f-931b-b50414568c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5882611c-773b-4f2f-931b-b50414568c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c608a-aa1e-422c-b32c-deb9891c29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c608a-aa1e-422c-b32c-deb9891c29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e09e9e-d933-4912-8523-c0f1315c3d45', 'volume_name': 'volume-77e09e9e-d933-4912-8523-c0f1315c3d45', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9441b19f-fa1d-4ba4-89bd-47d0fc6a007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9441b19f-fa1d-4ba4-89bd-47d0fc6a007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2b893d-e091-4373-8b53-a4d9c72a777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:28 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Volume 77e09e9e-d933-4912-8523-c0f1315c3d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e09e9e-d933-4912-8523-c0f1315c3d45', 'volume_size': 1} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca 1073741824" returned: 0 in 0.946s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" returned: 0 in 0.213s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1209ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-254801332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e09e9e-d933-4912-8523-c0f1315c3d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Creating volume 77e09e9e-d933-4912-8523-c0f1315c3d45 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:28 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:28 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:29 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=147, name=volume-77e09e9e-d933-4912-8523-c0f1315c3d45, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (9dcee498-4096-47e1-af2b-b03111055ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a1c90-de4d-4b59-b087-cec68c8144f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (e6be53be-1f65-4c7e-a7d8-fcf1a30efa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b79e6d-e183-4c4a-9b38-9bc7e2356553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b79e6d-e183-4c4a-9b38-9bc7e2356553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195102935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba328dfe-7779-4a4d-9a4f-355c61882792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:28Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f56e0e8-c3ec-430c-bd92-045aa3b0fa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f56e0e8-c3ec-430c-bd92-045aa3b0fa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e409db44-5ef2-4b0b-a3ae-a667c53de14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e409db44-5ef2-4b0b-a3ae-a667c53de14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba328dfe-7779-4a4d-9a4f-355c61882792', 'volume_name': 'volume-ba328dfe-7779-4a4d-9a4f-355c61882792', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858276b5-376a-4d52-b934-58e710316457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858276b5-376a-4d52-b934-58e710316457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4bae39-efdf-4819-8c27-77848d789cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:29 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Volume ba328dfe-7779-4a4d-9a4f-355c61882792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba328dfe-7779-4a4d-9a4f-355c61882792', 'volume_size': 1} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a8bc27-88e9-42bb-bed2-c2378e82ac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:29 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d64ffb5-347d-4c41-bb04-4d8e1a49c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629a1c90-de4d-4b59-b087-cec68c8144f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37316267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8afbd2a-3afe-4676-a795-8238fa425f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f1f0a-0b2c-4481-bba4-aadb06b59d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888f1f0a-0b2c-4481-bba4-aadb06b59d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3f008-02c1-44e7-b9bc-e02eb9f7b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3f008-02c1-44e7-b9bc-e02eb9f7b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8afbd2a-3afe-4676-a795-8238fa425f46', 'volume_name': 'volume-a8afbd2a-3afe-4676-a795-8238fa425f46', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd498a7f-2d1a-401f-aed7-3c6b399e9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd498a7f-2d1a-401f-aed7-3c6b399e9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b190ce7b-d417-46d3-a261-4c80b9ed9b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Volume a8afbd2a-3afe-4676-a795-8238fa425f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8afbd2a-3afe-4676-a795-8238fa425f46', 'volume_size': 1} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45 1073741824" returned: 0 in 1.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (1388af4b-6407-4f39-9783-a21caa96c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce93522c-7abb-43d6-acff-ac57d8dac460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce93522c-7abb-43d6-acff-ac57d8dac460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872433356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db512ac-2e33-4415-b246-039efe4e5f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:30Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd595f08-f712-4a5e-becd-fbfdd286d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd595f08-f712-4a5e-becd-fbfdd286d172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7994519-dcf1-41dc-9765-ae32572f1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7994519-dcf1-41dc-9765-ae32572f1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db512ac-2e33-4415-b246-039efe4e5f93', 'volume_name': 'volume-0db512ac-2e33-4415-b246-039efe4e5f93', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101c9d95-8fcb-4430-88ab-b2eadb9cd1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101c9d95-8fcb-4430-88ab-b2eadb9cd1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf03445d-7fc1-4591-82ec-a41b84383c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:30 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Volume 0db512ac-2e33-4415-b246-039efe4e5f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db512ac-2e33-4415-b246-039efe4e5f93', 'volume_size': 1} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:30 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca (e2697042-fb57-48ca-8b9c-3bb2b9dd9eca): created successfully Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d64ffb5-347d-4c41-bb04-4d8e1a49c59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (6e1c9a30-fb71-48c8-8289-b22f3557a144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45" returned: 0 in 0.556s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] <== create_volume: return (1742ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195102935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba328dfe-7779-4a4d-9a4f-355c61882792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:28Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Creating volume ba328dfe-7779-4a4d-9a4f-355c61882792 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:30 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:30 devstack quobyte-client[83541]: System call of process 101491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:30 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=148, name=volume-ba328dfe-7779-4a4d-9a4f-355c61882792, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:30 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (3cf467de-33a1-4058-bc7d-e7ce22f9eaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18761fe6-72a4-405c-a098-115a08d71631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-64161f57-d2ae-448f-991d-2244696a9d18 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2b893d-e091-4373-8b53-a4d9c72a777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e09e9e-d933-4912-8523-c0f1315c3d45', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5048e974-14b1-462d-a342-29b4df549afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18761fe6-72a4-405c-a098-115a08d71631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-904236757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc826adb-065f-45b3-bfe8-34147ed20007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:30Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e394a6-3c6d-427b-8b4b-b54037743aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e394a6-3c6d-427b-8b4b-b54037743aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd66f2b-949a-4633-9ea1-e7c142e63e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd66f2b-949a-4633-9ea1-e7c142e63e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc826adb-065f-45b3-bfe8-34147ed20007', 'volume_name': 'volume-bc826adb-065f-45b3-bfe8-34147ed20007', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f04c7f-359c-47a5-9053-11512cbb1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f04c7f-359c-47a5-9053-11512cbb1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5843a49a-6ffa-44ce-a2da-cfc7320bd6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:31 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Volume bc826adb-065f-45b3-bfe8-34147ed20007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc826adb-065f-45b3-bfe8-34147ed20007', 'volume_size': 1} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792 1073741824" returned: 0 in 0.917s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:31 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Volume volume-77e09e9e-d933-4912-8523-c0f1315c3d45 (77e09e9e-d933-4912-8523-c0f1315c3d45): created successfully Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5048e974-14b1-462d-a342-29b4df549afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (1d4ddac4-b615-4e43-9ef3-5e24eb82406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:31 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792" returned: 0 in 0.266s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] <== create_volume: return (1230ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-37316267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8afbd2a-3afe-4676-a795-8238fa425f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:27Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Creating volume a8afbd2a-3afe-4676-a795-8238fa425f46 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:32 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:32 devstack quobyte-client[83541]: System call of process 101495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:32 devstack quobyte-client[83541]: System call of process 101495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:32 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=149, name=volume-a8afbd2a-3afe-4676-a795-8238fa425f46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6568b446-6b07-408e-9ad1-628df75f0a8b tempest-CreateVolumesFromImageTest-1362762756 None] Created volume successfully. Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4bae39-efdf-4819-8c27-77848d789cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba328dfe-7779-4a4d-9a4f-355c61882792', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb379d83-265a-45bf-b16e-b7158da95065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:32 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Volume volume-ba328dfe-7779-4a4d-9a4f-355c61882792 (ba328dfe-7779-4a4d-9a4f-355c61882792): created successfully Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb379d83-265a-45bf-b16e-b7158da95065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (e6be53be-1f65-4c7e-a7d8-fcf1a30efa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46 1073741824" returned: 0 in 0.551s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:32 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb053a5e-b21f-4625-9562-77399d4d6f7c tempest-CreateVolumesFromImageTest-1362762756 None] Created volume successfully. Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46" returned: 0 in 0.356s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.545s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872433356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db512ac-2e33-4415-b246-039efe4e5f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:30Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Creating volume 0db512ac-2e33-4415-b246-039efe4e5f93 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:33 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:33 devstack quobyte-client[83541]: System call of process 101499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:33 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=150, name=volume-0db512ac-2e33-4415-b246-039efe4e5f93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b190ce7b-d417-46d3-a261-4c80b9ed9b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8afbd2a-3afe-4676-a795-8238fa425f46', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4df4af3-6150-4e0d-b471-b284d6d6f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:33 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Volume volume-a8afbd2a-3afe-4676-a795-8238fa425f46 (a8afbd2a-3afe-4676-a795-8238fa425f46): created successfully Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4df4af3-6150-4e0d-b471-b284d6d6f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (9dcee498-4096-47e1-af2b-b03111055ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93 1073741824" returned: 0 in 0.540s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:33 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a2f8c548-c003-4c3d-a127-be4e430833fc tempest-CreateVolumesFromImageTest-1362762756 None] Created volume successfully. Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93" returned: 0 in 0.319s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] <== create_volume: return (894ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-904236757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc826adb-065f-45b3-bfe8-34147ed20007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28ad96503514c249fc3714085f6375d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:30Z,use_quota=True,user_id='e2fb29aca6f640d28e6f354d39343717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Creating volume bc826adb-065f-45b3-bfe8-34147ed20007 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:33 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:34 devstack quobyte-client[83541]: System call of process 101503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:34 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=151, name=volume-bc826adb-065f-45b3-bfe8-34147ed20007, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf03445d-7fc1-4591-82ec-a41b84383c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db512ac-2e33-4415-b246-039efe4e5f93', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4407898c-83fb-497c-9d03-1a1a0ae8424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007 1073741824" returned: 0 in 0.537s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007" returned: 0 in 0.154s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] <== create_volume: return (740ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.908s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Volume volume-0db512ac-2e33-4415-b246-039efe4e5f93 (0db512ac-2e33-4415-b246-039efe4e5f93): created successfully Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4407898c-83fb-497c-9d03-1a1a0ae8424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (1388af4b-6407-4f39-9783-a21caa96c576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5843a49a-6ffa-44ce-a2da-cfc7320bd6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc826adb-065f-45b3-bfe8-34147ed20007', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aec9ce-bdda-4f56-bbb3-ccfb6fc2aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating offline snapshot ea32f551-d8da-44d1-8c93-f037eaa243d5 of volume e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fea2dd-3521-41e3-aef7-24397ee7fdc9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:35 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-87e57a40-517e-470e-8b70-2d07ac5a688a tempest-CreateVolumesFromImageTest-1362762756 None] Created volume successfully. Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-bc826adb-065f-45b3-bfe8-34147ed20007-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:35 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Volume volume-bc826adb-065f-45b3-bfe8-34147ed20007 (bc826adb-065f-45b3-bfe8-34147ed20007): created successfully Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aec9ce-bdda-4f56-bbb3-ccfb6fc2aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:35 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Flow 'volume_create_manager' (3cf467de-33a1-4058-bc7d-e7ce22f9eaa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:36 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-86b11b32-76ef-4df0-b323-094b2c7beade tempest-CreateVolumesFromImageTest-1362762756 None] Created volume successfully. Sep 16 13:36:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" returned: 0 in 1.018s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:36 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-bc826adb-065f-45b3-bfe8-34147ed20007-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:36 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=152, name=volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 1G" returned: 0 in 0.567s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-quobyte-bc826adb-065f-45b3-bfe8-34147ed20007" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img rebase -u -b volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.808s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.312s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:36:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-bc826adb-065f-45b3-bfe8-34147ed20007" acquired by "delete_volume" :: waited 0.645s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff64402-e4d6-4e72-a6c1-7c2dc08de4d7]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.593s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.info" returned: 0 in 0.199s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.info" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:39 devstack quobyte-client[83541]: System call of process 101519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:39 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4f47230f-fe1b-44b2-8c46-a86be0d354ef tempest-CreateVolumesFromSnapshotTest-502334677 None] Create snapshot completed successfully Sep 16 13:36:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007" returned: 0 in 1.090s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-bc826adb-065f-45b3-bfe8-34147ed20007" returned: 0 in 0.257s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:39 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-bc826adb-065f-45b3-bfe8-34147ed20007" released by "delete_volume" :: held 1.617s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:39 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Created reservations ['96d15e28-f93a-4d96-a111-2b345edb3a2d', 'bf4c8e8c-70a9-4d41-879e-246eba55505c', 'd30d8873-f10b-4b07-9756-8cb9f77a9527', 'f1a1b930-4e9a-464a-92ad-d04bcbcaee52'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.245s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:40 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:40 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Deleted volume successfully. Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-0db512ac-2e33-4415-b246-039efe4e5f93-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-0db512ac-2e33-4415-b246-039efe4e5f93-delete_volume" acquired by "delete_volume" :: waited 0.988s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d47048b7-724a-47a4-8a92-749477e055ad tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-bc826adb-065f-45b3-bfe8-34147ed20007-delete_volume" released by "delete_volume" :: held 6.017s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (a914f162-0e2e-4940-85a5-cad962eae253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dac711-01b2-4d68-b7fd-faf6e4bab417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.213s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:42 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (51d721cb-1c29-4a91-90dd-55931fbba5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04176c11-f1e6-4f9b-988b-a06d77c4ef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dac711-01b2-4d68-b7fd-faf6e4bab417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147743929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1bdd5-60df-4f68-ba01-fd0427796f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:41Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62996aed-bc31-4c03-83dd-5179d097f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62996aed-bc31-4c03-83dd-5179d097f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa599a3-d68b-4885-9b87-e3bf91ae80af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa599a3-d68b-4885-9b87-e3bf91ae80af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c1bdd5-60df-4f68-ba01-fd0427796f8c', 'volume_name': 'volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906a04a2-b6c5-4ed0-8efe-54c8d412e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906a04a2-b6c5-4ed0-8efe-54c8d412e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edc86aa-417c-4ee0-a516-fb716e6ac4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:42 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume 30c1bdd5-60df-4f68-ba01-fd0427796f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c', 'volume_size': 1} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147743929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1bdd5-60df-4f68-ba01-fd0427796f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:41Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume 30c1bdd5-60df-4f68-ba01-fd0427796f8c {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:42 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:43 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=154, name=volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (5753256d-257b-459b-b398-36543abc201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436d57a0-0a47-4f4a-a018-4ef9db627946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-quobyte-0db512ac-2e33-4415-b246-039efe4e5f93" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04176c11-f1e6-4f9b-988b-a06d77c4ef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580748652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0f4081-1748-4afc-a5e2-76aa14d30042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:41Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb496ac-8fe3-4ba0-b219-484b3ed39fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb496ac-8fe3-4ba0-b219-484b3ed39fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8490f3a-2623-4ed6-8189-3981be2a08da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8490f3a-2623-4ed6-8189-3981be2a08da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0f4081-1748-4afc-a5e2-76aa14d30042', 'volume_name': 'volume-9d0f4081-1748-4afc-a5e2-76aa14d30042', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea1031-4e63-4a68-bd68-56884e04a425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccea1031-4e63-4a68-bd68-56884e04a425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2fad49-564a-443f-b8e8-199eefdc495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume 9d0f4081-1748-4afc-a5e2-76aa14d30042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0f4081-1748-4afc-a5e2-76aa14d30042', 'volume_size': 1} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436d57a0-0a47-4f4a-a018-4ef9db627946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533451179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838b5835-186e-4444-955a-e562f894e1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:42Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cccb2f8-c161-47e2-9496-1ae804cc35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cccb2f8-c161-47e2-9496-1ae804cc35ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18703902-5366-4fb3-935a-91db9c18247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18703902-5366-4fb3-935a-91db9c18247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838b5835-186e-4444-955a-e562f894e1c3', 'volume_name': 'volume-838b5835-186e-4444-955a-e562f894e1c3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298abcb3-30a8-4293-aa3b-e9dff907df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298abcb3-30a8-4293-aa3b-e9dff907df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfb6392-0ffd-45f1-a6f1-5de884526bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume 838b5835-186e-4444-955a-e562f894e1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838b5835-186e-4444-955a-e562f894e1c3', 'volume_size': 1} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c 1073741824" returned: 0 in 0.950s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (52d3aebf-84d4-4813-b98e-cfb39b2ad103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa58d3d4-b3c5-49cc-a01d-fa057be31d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa58d3d4-b3c5-49cc-a01d-fa057be31d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085840310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15bd55e-66ab-47e0-949b-9850d406bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:43Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac1dcb5-7810-4ca6-9ca6-feb25dd3d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac1dcb5-7810-4ca6-9ca6-feb25dd3d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd8c8a7-8c31-4a2f-ab9e-346cc05c407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd8c8a7-8c31-4a2f-ab9e-346cc05c407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15bd55e-66ab-47e0-949b-9850d406bfef', 'volume_name': 'volume-a15bd55e-66ab-47e0-949b-9850d406bfef', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19d4ce3-73be-4569-920f-2bcc9caec8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19d4ce3-73be-4569-920f-2bcc9caec8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071d8e14-962b-4233-9932-d04ca59afa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume a15bd55e-66ab-47e0-949b-9850d406bfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15bd55e-66ab-47e0-949b-9850d406bfef', 'volume_size': 1} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-0db512ac-2e33-4415-b246-039efe4e5f93" acquired by "delete_volume" :: waited 0.927s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c" returned: 0 in 0.805s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1778ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:44 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (f2ddf59f-69a6-42e7-b14a-0bbc9534c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95a43df-acfd-4484-b249-f33fdfe3ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[315910ea-f757-4388-abcf-814f80367913]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580748652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0f4081-1748-4afc-a5e2-76aa14d30042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:41Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume 9d0f4081-1748-4afc-a5e2-76aa14d30042 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:44 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:45 devstack quobyte-client[83541]: System call of process 101535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:45 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=155, name=volume-9d0f4081-1748-4afc-a5e2-76aa14d30042, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edc86aa-417c-4ee0-a516-fb716e6ac4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff12125f-aa5e-4d75-8ecd-e6c7e41706bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95a43df-acfd-4484-b249-f33fdfe3ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-880168792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29dc43d-bc19-4653-988a-426b4773c132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:43Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093a2211-93a1-4776-909e-0c19f101f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093a2211-93a1-4776-909e-0c19f101f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f812cbec-93b1-4246-9c83-67bb3da31a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f812cbec-93b1-4246-9c83-67bb3da31a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29dc43d-bc19-4653-988a-426b4773c132', 'volume_name': 'volume-f29dc43d-bc19-4653-988a-426b4773c132', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652347de-358f-4408-bbff-9f97fa989c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652347de-358f-4408-bbff-9f97fa989c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0f70b7-28b8-4646-999e-6fb1596cb895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume f29dc43d-bc19-4653-988a-426b4773c132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29dc43d-bc19-4653-988a-426b4773c132', 'volume_size': 1} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c (30c1bdd5-60df-4f68-ba01-fd0427796f8c): created successfully Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff12125f-aa5e-4d75-8ecd-e6c7e41706bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (a914f162-0e2e-4940-85a5-cad962eae253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 1073741824" returned: 0 in 1.050s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-35a895cd-3a34-462e-b4fb-1d55ce7b27f0 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93" returned: 0 in 1.416s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042" returned: 0 in 0.450s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1587ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.761s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-533451179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838b5835-186e-4444-955a-e562f894e1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:42Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume 838b5835-186e-4444-955a-e562f894e1c3 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:46 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:46 devstack quobyte-client[83541]: System call of process 101544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:46 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=156, name=volume-838b5835-186e-4444-955a-e562f894e1c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2fad49-564a-443f-b8e8-199eefdc495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0f4081-1748-4afc-a5e2-76aa14d30042', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0b1825-2200-4c43-b7fd-b2baf4528866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0db512ac-2e33-4415-b246-039efe4e5f93" returned: 0 in 1.082s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:47 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 (9d0f4081-1748-4afc-a5e2-76aa14d30042): created successfully Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0b1825-2200-4c43-b7fd-b2baf4528866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (51d721cb-1c29-4a91-90dd-55931fbba5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-0db512ac-2e33-4415-b246-039efe4e5f93" released by "delete_volume" :: held 2.822s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3 1073741824" returned: 0 in 0.887s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:47 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b9eeda71-e7b6-431d-b104-3a7bebb13710 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3" returned: 0 in 0.421s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1365ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.411s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085840310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15bd55e-66ab-47e0-949b-9850d406bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:43Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume a15bd55e-66ab-47e0-949b-9850d406bfef {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:48 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:48 devstack quobyte-client[83541]: System call of process 101549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:48 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=157, name=volume-a15bd55e-66ab-47e0-949b-9850d406bfef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfb6392-0ffd-45f1-a6f1-5de884526bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838b5835-186e-4444-955a-e562f894e1c3', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839bd95-3acc-4327-a7e4-52663f1a1b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef 1073741824" returned: 0 in 0.575s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:48 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-838b5835-186e-4444-955a-e562f894e1c3 (838b5835-186e-4444-955a-e562f894e1c3): created successfully Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839bd95-3acc-4327-a7e4-52663f1a1b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:48 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (5753256d-257b-459b-b398-36543abc201b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Created reservations ['d8f12cc9-6d74-4e97-8ee2-d6870066168e', '8ca267f2-c774-4fd6-9530-c38d63dc94c8', '91805301-88ba-43d2-b770-761d12b253d5', 'cf6a5a23-48bb-4242-8965-6248aaeaa477'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef" returned: 0 in 0.512s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1117ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.444s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-880168792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29dc43d-bc19-4653-988a-426b4773c132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2142602d775f41b7bbdd6cbe15958c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:36:43Z,use_quota=True,user_id='6012cd1d98484b529b21317bd39b34f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Creating volume f29dc43d-bc19-4653-988a-426b4773c132 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:36:49 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:49 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=158, name=volume-f29dc43d-bc19-4653-988a-426b4773c132, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:36:49 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-af22caa1-4bd9-47bb-bd86-72c1320872c4 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071d8e14-962b-4233-9932-d04ca59afa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15bd55e-66ab-47e0-949b-9850d406bfef', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20453b17-5506-4643-b73d-316c02d5f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:49 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-a15bd55e-66ab-47e0-949b-9850d406bfef (a15bd55e-66ab-47e0-949b-9850d406bfef): created successfully Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20453b17-5506-4643-b73d-316c02d5f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (52d3aebf-84d4-4813-b98e-cfb39b2ad103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132 1073741824" returned: 0 in 0.651s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-ac360e2d-0a97-4bdd-bdc8-59a1013f929d tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-ba328dfe-7779-4a4d-9a4f-355c61882792-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132" returned: 0 in 0.566s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] <== create_volume: return (1288ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-ba328dfe-7779-4a4d-9a4f-355c61882792-delete_volume" acquired by "delete_volume" :: waited 0.397s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0f70b7-28b8-4646-999e-6fb1596cb895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29dc43d-bc19-4653-988a-426b4773c132', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0819ea1-618a-4102-ad38-6ec522c9a5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.510s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:51 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume volume-f29dc43d-bc19-4653-988a-426b4773c132 (f29dc43d-bc19-4653-988a-426b4773c132): created successfully Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0819ea1-618a-4102-ad38-6ec522c9a5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Flow 'volume_create_manager' (f2ddf59f-69a6-42e7-b14a-0bbc9534c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:36:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Deleted volume successfully. Sep 16 13:36:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4208a657-198b-4331-991e-df4a05cca0d7 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created volume successfully. Sep 16 13:36:51 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-quobyte-ba328dfe-7779-4a4d-9a4f-355c61882792" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-47109143-a49b-454a-ae59-7e69bb2b8f1b tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-0db512ac-2e33-4415-b246-039efe4e5f93-delete_volume" released by "delete_volume" :: held 9.230s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-ba328dfe-7779-4a4d-9a4f-355c61882792" acquired by "delete_volume" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3a72b5-340d-46d0-aafc-d5b366f68020]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792" returned: 0 in 0.472s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-ba328dfe-7779-4a4d-9a4f-355c61882792" returned: 0 in 0.128s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-f29dc43d-bc19-4653-988a-426b4773c132-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-ba328dfe-7779-4a4d-9a4f-355c61882792" released by "delete_volume" :: held 1.003s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-f29dc43d-bc19-4653-988a-426b4773c132-delete_volume" acquired by "delete_volume" :: waited 0.224s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-f29dc43d-bc19-4653-988a-426b4773c132" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-f29dc43d-bc19-4653-988a-426b4773c132" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Created reservations ['9d0d269f-3816-4602-8d90-d3769473cbbf', '280f6519-34cf-4f3f-9b4d-f55a886f776e', '2d589b5b-f8f1-43cd-af30-040294a55e58', '091681b4-8a11-426d-9210-d6fdfaf6bdb1'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1bb58e-5c51-4809-81a5-c3983270f3b4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:53 devstack quobyte-client[83541]: System call of process 101562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132" returned: 0 in 0.638s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-f29dc43d-bc19-4653-988a-426b4773c132" returned: 0 in 0.275s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-f29dc43d-bc19-4653-988a-426b4773c132" released by "delete_volume" :: held 1.072s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-a8afbd2a-3afe-4676-a795-8238fa425f46-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-a8afbd2a-3afe-4676-a795-8238fa425f46-delete_volume" acquired by "delete_volume" :: waited 0.399s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.427s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Deleted volume successfully. Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c6f41a12-14f7-4128-b229-437430fdf0be tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-ba328dfe-7779-4a4d-9a4f-355c61882792-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:54 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-quobyte-a8afbd2a-3afe-4676-a795-8238fa425f46" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['8b7334bb-c0b4-4ca4-9279-ed955297f180', 'd9c18ac4-e786-4317-b2ab-6b1d679b75ee', '1ab87218-6dbd-4b67-a2de-45477ac0e4a8', '302343ed-36d8-4dcb-8636-8c4087fd844d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-a8afbd2a-3afe-4676-a795-8238fa425f46" acquired by "delete_volume" :: waited 0.040s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc1854a-9dae-41e3-ae2e-9069e58fed6d]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46" returned: 0 in 0.691s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.299s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a8afbd2a-3afe-4676-a795-8238fa425f46" returned: 0 in 0.228s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-a15bd55e-66ab-47e0-949b-9850d406bfef-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-a8afbd2a-3afe-4676-a795-8238fa425f46" released by "delete_volume" :: held 1.247s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-555d42d8-c25c-479a-91a4-458632852c28 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-f29dc43d-bc19-4653-988a-426b4773c132-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-a15bd55e-66ab-47e0-949b-9850d406bfef-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:56 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-a15bd55e-66ab-47e0-949b-9850d406bfef" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-a15bd55e-66ab-47e0-949b-9850d406bfef" acquired by "delete_volume" :: waited 0.023s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Created reservations ['70c6dc4d-a0f5-457b-a534-67eed427edfb', '71c9d544-97d3-4ded-95da-ba4dd3be4b9e', '96bb0b1c-6ab0-4b53-b638-7226feadb5dd', '4def7152-3b9d-46f4-a603-c1a469ded011'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafff6b2-e866-489d-9adb-753ee71203a7]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef" returned: 0 in 0.824s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-77e09e9e-d933-4912-8523-c0f1315c3d45-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a15bd55e-66ab-47e0-949b-9850d406bfef" returned: 0 in 0.740s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.492s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-77e09e9e-d933-4912-8523-c0f1315c3d45-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-a15bd55e-66ab-47e0-949b-9850d406bfef" released by "delete_volume" :: held 1.962s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:58 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Deleted volume successfully. Sep 16 13:36:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "cinder-quobyte-77e09e9e-d933-4912-8523-c0f1315c3d45" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-68654519-d298-42c0-ae0d-85b350ba03fa tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-a8afbd2a-3afe-4676-a795-8238fa425f46-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-77e09e9e-d933-4912-8523-c0f1315c3d45" acquired by "delete_volume" :: waited 0.152s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[131aeb47-90e7-4d07-9bf7-1dad21766097]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:58 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['cd5d1a7f-43d8-4ea5-a076-311fb0b18d97', '1a98e902-fb0e-4ac6-9621-5b0a82af0715', 'f38b83cc-8c2d-44b3-9ed3-6b2ca0e4b070', 'e20ab26d-a71c-4364-9106-255d429280e4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:36:59 devstack quobyte-client[83541]: System call of process 101578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45" returned: 0 in 0.971s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-77e09e9e-d933-4912-8523-c0f1315c3d45" returned: 0 in 0.132s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.351s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:36:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-quobyte-77e09e9e-d933-4912-8523-c0f1315c3d45" released by "delete_volume" :: held 1.346s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0de0fdb1-b020-4cb6-97c9-bd2286602214 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-a15bd55e-66ab-47e0-949b-9850d406bfef-delete_volume" released by "delete_volume" :: held 4.246s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Created reservations ['6e1d7084-4c6e-48e2-87b1-80ac62a9718f', '7f7fbae2-30de-4422-8f07-38ab76b3bbda', '1a9f4a59-73d9-4fd4-92b4-7525d644fd55', '68dcee00-de1b-4e3e-bcd0-c2b2a4b3e195'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-838b5835-186e-4444-955a-e562f894e1c3-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-838b5835-186e-4444-955a-e562f894e1c3-delete_volume" acquired by "delete_volume" :: waited 0.267s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.412s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:01 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-838b5835-186e-4444-955a-e562f894e1c3" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:01 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Deleted volume successfully. Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-838b5835-186e-4444-955a-e562f894e1c3" acquired by "delete_volume" :: waited 0.032s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[40862f13-e950-4611-abd7-3c422e628fec]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-59c173ab-16a0-4635-a748-364674f4cb1d tempest-CreateVolumesFromImageTest-1362762756 None] Lock "cinder-77e09e9e-d933-4912-8523-c0f1315c3d45-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3" returned: 0 in 0.806s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-838b5835-186e-4444-955a-e562f894e1c3" returned: 0 in 0.108s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:02 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-838b5835-186e-4444-955a-e562f894e1c3" released by "delete_volume" :: held 1.099s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:02 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['a3d67697-19da-4dda-a692-2847999b946d', '88a547fc-5db8-4810-9942-c5457f539495', '2e5c214a-90b7-4a54-8e27-0bbd2071a691', '37be9a0e-d4c1-42ea-af87-b657e868e576'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.149s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:03 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:37:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-fddd27ab-f179-4aee-9dcd-22fa8a3d5aca tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-838b5835-186e-4444-955a-e562f894e1c3-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-9d0f4081-1748-4afc-a5e2-76aa14d30042-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-9d0f4081-1748-4afc-a5e2-76aa14d30042-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:04 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-9d0f4081-1748-4afc-a5e2-76aa14d30042" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-9d0f4081-1748-4afc-a5e2-76aa14d30042" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b889b5-1e1c-4f2b-87b9-5e250606178b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042" returned: 0 in 0.722s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:05 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9d0f4081-1748-4afc-a5e2-76aa14d30042" returned: 0 in 0.129s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-9d0f4081-1748-4afc-a5e2-76aa14d30042" released by "delete_volume" :: held 1.104s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['81c1efb8-54c2-4d27-87bf-b939f8ae825c', '403beed7-5eb7-49b2-9bf1-caddf3902911', '571b07c5-8727-4cd7-af3c-dc8b275bbe8a', '89632aae-6f29-4398-99c6-7094c04dafaa'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.207s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:06 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:37:06 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-30c1bdd5-60df-4f68-ba01-fd0427796f8c-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-4ec5fe76-149f-4de0-a0fd-97033ec28d5e tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-9d0f4081-1748-4afc-a5e2-76aa14d30042-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-30c1bdd5-60df-4f68-ba01-fd0427796f8c-delete_volume" acquired by "delete_volume" :: waited 0.245s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:07 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-30c1bdd5-60df-4f68-ba01-fd0427796f8c" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-30c1bdd5-60df-4f68-ba01-fd0427796f8c" acquired by "delete_volume" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136b167-2831-4d07-9d54-734fe436c32b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:07 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c" returned: 0 in 0.853s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:08 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-30c1bdd5-60df-4f68-ba01-fd0427796f8c" returned: 0 in 0.192s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:08 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-30c1bdd5-60df-4f68-ba01-fd0427796f8c" released by "delete_volume" :: held 1.328s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['440a1bc5-c9ca-4305-adb8-394dae6dd351', 'ad63fcb3-4f15-4eba-a2d4-4875e6343352', '26020421-524a-48a1-9091-b3340d209288', '8c5cc290-9543-4c13-8fe5-f920b65a73a4'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.172s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:09 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:37:09 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b93ea273-3c5a-41ad-9e58-225026f67c75 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-30c1bdd5-60df-4f68-ba01-fd0427796f8c-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Flow 'volume_create_manager' (97986904-8a31-42ad-a66e-56c99ab0194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52c114b-d83b-4086-81fa-7f05cff978a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-ea32f551-d8da-44d1-8c93-f037eaa243d5-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-ea32f551-d8da-44d1-8c93-f037eaa243d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-ea32f551-d8da-44d1-8c93-f037eaa243d5" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52c114b-d83b-4086-81fa-7f05cff978a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-456143585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f243d3-df8c-44ae-bd83-0f1858eef5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b93c1c197549e9a18862f8742ee281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:10Z,use_quota=True,user_id='52167f53d56341e7b6f59de280fd5bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1874a944-a3b6-4ebd-9864-92f39f4f99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1874a944-a3b6-4ebd-9864-92f39f4f99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e2caee-1bff-438a-bd9a-c588b2381405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e2caee-1bff-438a-bd9a-c588b2381405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f243d3-df8c-44ae-bd83-0f1858eef5e6', 'volume_name': 'volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0f4ae-98c8-4b0a-b6f9-54dae0a43168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0f4ae-98c8-4b0a-b6f9-54dae0a43168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a12bf55-cb49-4aa9-9256-88b63ff435f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Volume e3f243d3-df8c-44ae-bd83-0f1858eef5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6', 'volume_size': 1} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-456143585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f243d3-df8c-44ae-bd83-0f1858eef5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b93c1c197549e9a18862f8742ee281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:10Z,use_quota=True,user_id='52167f53d56341e7b6f59de280fd5bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Creating volume e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:10 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:10 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=159, name=volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-ea32f551-d8da-44d1-8c93-f037eaa243d5" acquired by "_delete_snapshot" :: waited 0.250s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleting offline snapshot ea32f551-d8da-44d1-8c93-f037eaa243d5 of volume e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] snapshot_file for this snap is: volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2cf55d-b059-4367-a812-1a80e309b1a2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 1073741824" returned: 0 in 0.491s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.166s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a12bf55-cb49-4aa9-9256-88b63ff435f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b191e27-6c6f-48a3-a151-3869be76b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.928s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29fd15f-f528-449d-ac28-4c2a188b96f3]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:11 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Volume volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 (e3f243d3-df8c-44ae-bd83-0f1858eef5e6): created successfully Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b191e27-6c6f-48a3-a151-3869be76b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Flow 'volume_create_manager' (97986904-8a31-42ad-a66e-56c99ab0194d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Flow 'volume_create_manager' (9eb87cf8-a3f8-4aeb-aee3-179e106e952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070258f-d34f-4002-91d1-a084f0c541ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:12 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6e2bb5c0-4196-47be-9c39-f68d3b9ee3b9 tempest-SnapshotDependencyTests-1633327346 None] Created volume successfully. Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070258f-d34f-4002-91d1-a084f0c541ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fbd345-cba3-4855-85b0-144111547569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca699aede3f248a7998a825043bd6387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:11Z,use_quota=True,user_id='046c95d2c337490b92453de8c4c8638a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21011d06-3d90-4021-91a2-bd610e30d974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21011d06-3d90-4021-91a2-bd610e30d974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20a1614-292f-4244-aad3-fcd1a3bd43b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG cinder.image.glance [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Creating Keystone auth plugin from conf {{(pid=83513) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" returned: 0 in 0.749s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.535s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:13 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca.ea32f551-d8da-44d1-8c93-f037eaa243d5" returned: 0 in 0.518s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Creating offline snapshot a0b54547-9859-4b77-a00e-a78d2757c5d0 of volume e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-ea32f551-d8da-44d1-8c93-f037eaa243d5" released by "_delete_snapshot" :: held 3.074s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20a1614-292f-4244-aad3-fcd1a3bd43b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17fbd345-cba3-4855-85b0-144111547569', 'volume_name': 'volume-17fbd345-cba3-4855-85b0-144111547569', 'volume_size': 1, 'image_id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7797f4a78f4be692a2265461110358b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca699aede3f248a7998a825043bd6387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '084b2a91a90549ad7816d2748e1d919df0f858602ea69a85d42d3538727ee53e8ec7bcb5b5274433f0ee3c6ff8edb4250126215c5b756b1fba32179eff4e44ec', 'id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'created_at': datetime.datetime(2025, 9, 16, 11, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 37, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40efe33-b065-4bf8-838d-65f004259abb/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510a1f4-e5e2-4d59-9a8b-2b0571c398d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5510a1f4-e5e2-4d59-9a8b-2b0571c398d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462c5c55-6778-4f69-8922-68a2a1cf7fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:13 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Volume 17fbd345-cba3-4855-85b0-144111547569: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17fbd345-cba3-4855-85b0-144111547569', 'volume_size': 1, 'image_id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7797f4a78f4be692a2265461110358b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca699aede3f248a7998a825043bd6387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '084b2a91a90549ad7816d2748e1d919df0f858602ea69a85d42d3538727ee53e8ec7bcb5b5274433f0ee3c6ff8edb4250126215c5b756b1fba32179eff4e44ec', 'id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'created_at': datetime.datetime(2025, 9, 16, 11, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 37, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40efe33-b065-4bf8-838d-65f004259abb/file', 'properties': {}}, 'image_service': } Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Cloning 17fbd345-cba3-4855-85b0-144111547569 from image a40efe33-b065-4bf8-838d-65f004259abb at location (None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}]). {{(pid=83513) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b17553c-40c4-42f4-861f-a8d2e6b0e8c4]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:13 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" released by "delete_snapshot" :: held 3.540s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:14 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 13:37:14 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Image download 0.00 MB at 0.00 MB/s Sep 16 13:37:14 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['f9a0fb05-4455-4778-99c4-fb67886d7d84', 'aed0c060-9d4b-4d9d-b627-ec907b9a8f0c', '0e0c0e1b-db0a-4cd1-8e4e-d582ae5770bc', '327310b3-7bea-4517-a4f3-7a9026717f78'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.658s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:14 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:14 devstack quobyte-client[83541]: System call of process 101623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:14 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=160, name=volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:14 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d913c70-acc5-4f74-8863-f66853869fc5]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 1G" returned: 0 in 1.100s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:15 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD Sep 16 13:37:15 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:37:15 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca-delete_volume" acquired by "delete_volume" :: waited 0.570s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Delete snapshot completed successfully. Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e76b950d-b8f1-4a43-8e96-727419d34a23 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-ea32f551-d8da-44d1-8c93-f037eaa243d5-delete_snapshot" released by "delete_snapshot" :: held 5.805s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "qemu-img rebase -u -b volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.593s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.407s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:16 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.143s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" acquired by "delete_volume" :: waited 0.493s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.info" returned: 0 in 0.371s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689ef15-7451-4e87-a90e-693ebe4715f2]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.info" returned: 0 in 0.430s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.266s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:18 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 16 13:37:18 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-16ac1afc-8625-477b-97d8-70cf6f72baf9 tempest-SnapshotDependencyTests-1633327346 None] Create snapshot completed successfully Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 0 in 3.285s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" returned: 0 in 0.930s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" returned: 0 in 0.125s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-quobyte-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca" released by "delete_volume" :: held 1.627s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:18 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD Sep 16 13:37:18 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Created reservations ['621dcacf-22a3-4b1c-931f-edacbf692f41', '52f48a1d-8d91-4d5b-800c-e474fb8ef12d', '2ea2e683-e51b-4754-b22c-1028b12b809d', 'd5898cd1-d949-4829-a638-1143b06f8814'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.167s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:19 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:20 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Deleted volume successfully. Sep 16 13:37:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-103418ef-393d-4510-8a7d-136a21784442 tempest-CreateVolumesFromSnapshotTest-502334677 None] Lock "cinder-e2697042-fb57-48ca-8b9c-3bb2b9dd9eca-delete_volume" released by "delete_volume" :: held 4.588s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:20 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:20 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Flow 'volume_create_manager' (d767e658-f4da-415e-a5db-d1f005223a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029889d4-7791-40a8-b739-0ad5f1711311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029889d4-7791-40a8-b739-0ad5f1711311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e5fa4-4c0e-49ea-8a63-97890cef572f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b93c1c197549e9a18862f8742ee281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0b54547-9859-4b77-a00e-a78d2757c5d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:21Z,use_quota=True,user_id='52167f53d56341e7b6f59de280fd5bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06668996-e4a7-42e9-882e-fb7aa63936e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06668996-e4a7-42e9-882e-fb7aa63936e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36798c22-dc18-4445-a10e-d78ff9f10faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36798c22-dc18-4445-a10e-d78ff9f10faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e37e5fa4-4c0e-49ea-8a63-97890cef572f', 'volume_name': 'volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f', 'volume_size': 1, 'snapshot_id': 'a0b54547-9859-4b77-a00e-a78d2757c5d0'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9e4eb3-c67d-44e5-90ba-2428a04675fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9e4eb3-c67d-44e5-90ba-2428a04675fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb107a9-58e8-49b4-8c9d-1edaa5912325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:21 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Volume e37e5fa4-4c0e-49ea-8a63-97890cef572f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f', 'volume_size': 1, 'snapshot_id': 'a0b54547-9859-4b77-a00e-a78d2757c5d0'} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0-e37e5fa4-4c0e-49ea-8a63-97890cef572f" by "_create_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0-e37e5fa4-4c0e-49ea-8a63-97890cef572f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Creating volume e37e5fa4-4c0e-49ea-8a63-97890cef572f from snapshot a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:359}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" by "_copy_volume_from_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] snapshot: a0b54547-9859-4b77-a00e-a78d2757c5d0, volume: e37e5fa4-4c0e-49ea-8a63-97890cef572f, {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:404}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[be45db92-e66d-4fd9-ae9b-3c65c7ee99ac]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:21 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 1 in 3.548s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:21 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Temporary image a40efe33-b065-4bf8-838d-65f004259abb is fetched for user 046c95d2c337490b92453de8c4c8638a. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.647s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Creating direct copy from snapshot {{(pid=83513) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3541e2d-5399-4483-b716-76a12469a41b]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b4b5e-5a28-416d-b92a-3c1b977254ff]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.638s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG cinder.utils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f not found in is_blk_device check {{(pid=83513) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 13:37:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:23 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=162, name=volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:23 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD Sep 16 13:37:23 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:37:29 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 16 13:37:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 0 in 6.931s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:29 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f" returned: 0 in 7.530s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:30 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f67a1-8271-4c08-a6c8-701e0a351337]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:30 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:30 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD Sep 16 13:37:30 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=82,cinder:UPDATE=123,cinder:DELETE=15,cinder:INSERT=20 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.934s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Image conversion details: src /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:37:31 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Converted 1024.00 MB image at 134.75 MB/s Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=77,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=29 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:37:31 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f" returned: 0 in 0.409s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" released by "_copy_volume_from_snapshot" :: held 10.689s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:32 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (922dd2e2-8b33-4d96-a717-cbd6cbd1d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f2a823-246b-4833-b59c-3c35d2316c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f2a823-246b-4833-b59c-3c35d2316c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813940117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c45c6fe-fec0-4073-8db0-0284ca36bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:31Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdf8091-31ac-461f-afce-ed1ecfeb2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdf8091-31ac-461f-afce-ed1ecfeb2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c9aa9e-a780-44a8-b5d1-79d7f950528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c9aa9e-a780-44a8-b5d1-79d7f950528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c45c6fe-fec0-4073-8db0-0284ca36bb51', 'volume_name': 'volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fe5177-669d-4978-b703-74cea499c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fe5177-669d-4978-b703-74cea499c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60913e78-9dcd-4a5f-bd77-25f554eec0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:32 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume 9c45c6fe-fec0-4073-8db0-0284ca36bb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51', 'volume_size': 1} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0-e37e5fa4-4c0e-49ea-8a63-97890cef572f" released by "_create_volume_from_snapshot" :: held 11.042s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.071s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1813940117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c45c6fe-fec0-4073-8db0-0284ca36bb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:31Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume 9c45c6fe-fec0-4073-8db0-0284ca36bb51 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:32 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:32 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:32 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=163, name=volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 1073741824" returned: 0 in 0.718s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:33 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb107a9-58e8-49b4-8c9d-1edaa5912325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f', 'volume_size': 1, 'snapshot_id': 'a0b54547-9859-4b77-a00e-a78d2757c5d0'}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24d40f3-f2a9-41e7-ba59-24f03f1a12ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 1 in 3.663s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51" returned: 0 in 0.379s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (1145ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fbd345-cba3-4855-85b0-144111547569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca699aede3f248a7998a825043bd6387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:11Z,use_quota=True,user_id='046c95d2c337490b92453de8c4c8638a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Creating volume 17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:33 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:33 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Volume volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f (e37e5fa4-4c0e-49ea-8a63-97890cef572f): created successfully Sep 16 13:37:33 devstack quobyte-client[83541]: System call of process 101715 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:33 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=164, name=volume-17fbd345-cba3-4855-85b0-144111547569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24d40f3-f2a9-41e7-ba59-24f03f1a12ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Flow 'volume_create_manager' (d767e658-f4da-415e-a5db-d1f005223a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60913e78-9dcd-4a5f-bd77-25f554eec0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11864144-6bef-40d7-a72a-cc0da4b09dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:33 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 1073741824" returned: 0 in 0.488s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:34 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 (9c45c6fe-fec0-4073-8db0-0284ca36bb51): created successfully Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11864144-6bef-40d7-a72a-cc0da4b09dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (922dd2e2-8b33-4d96-a717-cbd6cbd1d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-a0b54547-9859-4b77-a00e-a78d2757c5d0-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b2d4c397-9492-467d-b128-c5c66a1ea2e2 tempest-SnapshotDependencyTests-1633327346 None] Created volume successfully. Sep 16 13:37:34 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb4c885d-c96f-4f05-9ec6-4fdd305df033 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 0 in 0.485s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] <== create_volume: return (999ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-a0b54547-9859-4b77-a00e-a78d2757c5d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.117s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:34 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Deleting offline snapshot a0b54547-9859-4b77-a00e-a78d2757c5d0 of volume e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] snapshot_file for this snap is: volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed184066-336b-44c6-817f-8f171bdb2094]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:34 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Attempting download of a40efe33-b065-4bf8-838d-65f004259abb ((None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}])) to volume 17fbd345-cba3-4855-85b0-144111547569. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70eb57-8cbb-4e38-b460-a0c64128d03d]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a40efe33-b065-4bf8-838d-65f004259abb_ehh6vraj {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.649s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a6547-55fc-450b-b948-6bfc289556ad]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a40efe33-b065-4bf8-838d-65f004259abb_ehh6vraj" returned: 0 in 0.891s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:35 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40efe33-b065-4bf8-838d-65f004259abb_ehh6vraj {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:36 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:36 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (b239a4af-00eb-4a04-9a15-121f6e3858bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:36 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1941593-e0a9-4da3-bd60-0b503ca4bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 1.492s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:36 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:37 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (1e4d643d-8ab0-4331-a12d-42ee00ed86c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8917a78-f7dc-4f32-a540-4576afe1d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40efe33-b065-4bf8-838d-65f004259abb_ehh6vraj" returned: 1 in 1.856s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40efe33-b065-4bf8-838d-65f004259abb_ehh6vraj' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1941593-e0a9-4da3-bd60-0b503ca4bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729163808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a88f2-5d31-4966-8343-0409ff6c23d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:36Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a971b3-f5be-4236-a1f3-d5e4ad6f884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a971b3-f5be-4236-a1f3-d5e4ad6f884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08288e1a-76ea-42c9-aa34-41ef92b35822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08288e1a-76ea-42c9-aa34-41ef92b35822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437a88f2-5d31-4966-8343-0409ff6c23d6', 'volume_name': 'volume-437a88f2-5d31-4966-8343-0409ff6c23d6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3637675-8ce1-47f8-a633-9094dce83d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3637675-8ce1-47f8-a633-9094dce83d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfcd76-e3e7-4f4a-b18c-0472a0a0ce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:37 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume 437a88f2-5d31-4966-8343-0409ff6c23d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437a88f2-5d31-4966-8343-0409ff6c23d6', 'volume_size': 1} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729163808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a88f2-5d31-4966-8343-0409ff6c23d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:36Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume 437a88f2-5d31-4966-8343-0409ff6c23d6 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:37 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:37 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:38 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=165, name=volume-437a88f2-5d31-4966-8343-0409ff6c23d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8917a78-f7dc-4f32-a540-4576afe1d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790740184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b4439-1ade-410d-be74-321702291b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:36Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901003d8-c1a4-4f63-8425-1ebb2a57417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901003d8-c1a4-4f63-8425-1ebb2a57417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957b4d7-28e2-4764-8614-96f1f5e3ddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957b4d7-28e2-4764-8614-96f1f5e3ddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94b4439-1ade-410d-be74-321702291b6a', 'volume_name': 'volume-a94b4439-1ade-410d-be74-321702291b6a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ef6492-f384-4abc-90b1-c1dc93a74f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ef6492-f384-4abc-90b1-c1dc93a74f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4612c9-7877-44c0-a878-5ad3ddf0a1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume a94b4439-1ade-410d-be74-321702291b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94b4439-1ade-410d-be74-321702291b6a', 'volume_size': 1} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e016f-b8c6-45b9-9a57-09fcbdae6ec5]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (799f1de7-d9db-4ead-8d53-8616b00c32fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2330a0e3-5836-4ec0-b55e-7ac36787fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2330a0e3-5836-4ec0-b55e-7ac36787fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356063961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa43746-988a-4163-8e5a-63de2013989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:38Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c17bc-f077-4506-93bd-d3b0f4a8b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c17bc-f077-4506-93bd-d3b0f4a8b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8878-f675-4dc6-a5ed-2338bbb58410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea8878-f675-4dc6-a5ed-2338bbb58410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa43746-988a-4163-8e5a-63de2013989d', 'volume_name': 'volume-0fa43746-988a-4163-8e5a-63de2013989d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a34329-429b-4298-8f67-233d64031215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a34329-429b-4298-8f67-233d64031215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc6cd7d-815b-4c29-bcbd-2806e850a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:38 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume 0fa43746-988a-4163-8e5a-63de2013989d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa43746-988a-4163-8e5a-63de2013989d', 'volume_size': 1} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:38 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (f9bab385-83e3-4d35-9399-2a541c0b58d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:38 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17b338d-8877-4acb-bd01-6c8316d98696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (830c4246-1795-467f-8bca-aad301a8aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1dd3ac-591b-4932-ad2e-3bcf455bdcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 2.269s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6 1073741824" returned: 0 in 1.271s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1dd3ac-591b-4932-ad2e-3bcf455bdcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235314305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c4d74e-03bd-409e-918a-e4d08edab664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:37Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a25c15-b8c2-4d72-b4a7-a4c153258c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a25c15-b8c2-4d72-b4a7-a4c153258c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8c6f5c-aec2-4481-ba3f-c40a3d66194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8c6f5c-aec2-4481-ba3f-c40a3d66194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c4d74e-03bd-409e-918a-e4d08edab664', 'volume_name': 'volume-a2c4d74e-03bd-409e-918a-e4d08edab664', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22022ab-8b5d-44fb-bfb6-a7d7f217af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22022ab-8b5d-44fb-bfb6-a7d7f217af8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9beba0-1cc5-4a30-931d-a0bb2f3d26e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume a2c4d74e-03bd-409e-918a-e4d08edab664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c4d74e-03bd-409e-918a-e4d08edab664', 'volume_size': 1} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17b338d-8877-4acb-bd01-6c8316d98696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167645581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b52104-c4d4-4639-a796-514226b6ea68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:37Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2022e02a-606f-4465-8d54-73d4f45ddf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2022e02a-606f-4465-8d54-73d4f45ddf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0620b7f2-0657-4033-be68-644713b61622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0620b7f2-0657-4033-be68-644713b61622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b52104-c4d4-4639-a796-514226b6ea68', 'volume_name': 'volume-17b52104-c4d4-4639-a796-514226b6ea68', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d0f39a-42ba-4194-9558-ceb66c61c8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d0f39a-42ba-4194-9558-ceb66c61c8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42c970c-4c29-4c83-a7c6-714c81745351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:39 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume 17b52104-c4d4-4639-a796-514226b6ea68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b52104-c4d4-4639-a796-514226b6ea68', 'volume_size': 1} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6.a0b54547-9859-4b77-a00e-a78d2757c5d0" returned: 0 in 0.526s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 0 in 1.126s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6" returned: 0 in 0.580s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (2012ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:39 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790740184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94b4439-1ade-410d-be74-321702291b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:36Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume a94b4439-1ade-410d-be74-321702291b6a {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:40 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:40 devstack quobyte-client[83541]: System call of process 101743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=166, name=volume-a94b4439-1ade-410d-be74-321702291b6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-a0b54547-9859-4b77-a00e-a78d2757c5d0" released by "_delete_snapshot" :: held 5.753s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddfcd76-e3e7-4f4a-b18c-0472a0a0ce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437a88f2-5d31-4966-8343-0409ff6c23d6', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3665ebef-087c-4949-a254-ade41e7254da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a 1073741824" returned: 0 in 0.501s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD" returned: 1 in 0.916s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] a40efe33-b065-4bf8-838d-65f004259abb was raw, converting to raw {{(pid=83513) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 13:37:40 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:40 devstack quobyte-client[83541]: System call of process 101749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:40 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=164, name=volume-17fbd345-cba3-4855-85b0-144111547569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" released by "delete_snapshot" :: held 6.449s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:41 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-437a88f2-5d31-4966-8343-0409ff6c23d6 (437a88f2-5d31-4966-8343-0409ff6c23d6): created successfully Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3665ebef-087c-4949-a254-ade41e7254da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (b239a4af-00eb-4a04-9a15-121f6e3858bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a" returned: 0 in 0.862s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (1438ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 0 in 0.880s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.804s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356063961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa43746-988a-4163-8e5a-63de2013989d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:38Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume 0fa43746-988a-4163-8e5a-63de2013989d {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:41 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a40efe33-b065-4bf8-838d-65f004259abb_1ipgj1exdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 13:37:41 devstack cinder-volume[83513]: INFO cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 13:37:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:41 devstack quobyte-client[83541]: System call of process 101753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:41 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=167, name=volume-0fa43746-988a-4163-8e5a-63de2013989d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-7388c817-17c0-44a5-8546-80fe7803cd71 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4612c9-7877-44c0-a878-5ad3ddf0a1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94b4439-1ade-410d-be74-321702291b6a', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c5282-6f13-4fd5-ad84-5f654d52f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 1.044s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d 1073741824" returned: 0 in 0.733s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:42 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-a94b4439-1ade-410d-be74-321702291b6a (a94b4439-1ade-410d-be74-321702291b6a): created successfully Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01c5282-6f13-4fd5-ad84-5f654d52f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (1e4d643d-8ab0-4331-a12d-42ee00ed86c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 1G" returned: 0 in 0.916s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:42 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d756e589-ff8e-4d08-a233-7350ebf7de50 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d" returned: 0 in 0.443s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (1255ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd8577-30a7-4e58-a6b5-e92f9610c001]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235314305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c4d74e-03bd-409e-918a-e4d08edab664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:37Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume a2c4d74e-03bd-409e-918a-e4d08edab664 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:42 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:43 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:43 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=168, name=volume-a2c4d74e-03bd-409e-918a-e4d08edab664, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc6cd7d-815b-4c29-bcbd-2806e850a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa43746-988a-4163-8e5a-63de2013989d', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d932f2-8b28-40de-8970-07ea8fd997dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664 1073741824" returned: 0 in 0.552s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Created reservations ['ef380647-575a-428c-88b1-98d74a94a3ef', 'a2fa940d-4a80-4e22-9131-298033c8e26f', 'c699e18a-bd4e-499e-b789-c89992de8cc8', '7e8707e5-6a89-49c0-880e-09be84976e77'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:43 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-0fa43746-988a-4163-8e5a-63de2013989d (0fa43746-988a-4163-8e5a-63de2013989d): created successfully Sep 16 13:37:43 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d932f2-8b28-40de-8970-07ea8fd997dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (799f1de7-d9db-4ead-8d53-8616b00c32fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664" returned: 0 in 0.458s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 0 in 0.961s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.465s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167645581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b52104-c4d4-4639-a796-514226b6ea68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8a196b70874836939e2a61136594c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:37:37Z,use_quota=True,user_id='e95f198e3eb24264bdc28f3c61c48459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Creating volume 17b52104-c4d4-4639-a796-514226b6ea68 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:37:44 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:44 devstack quobyte-client[83541]: System call of process 101766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:44 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=169, name=volume-17b52104-c4d4-4639-a796-514226b6ea68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:37:44 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-578f98a4-4638-41a8-9b52-a5f949c10969 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9beba0-1cc5-4a30-931d-a0bb2f3d26e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c4d74e-03bd-409e-918a-e4d08edab664', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e194d0-9073-4b16-907d-2f165d22441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68 1073741824" returned: 0 in 0.748s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:44 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:44 devstack quobyte-client[83541]: System call of process 101767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-a2c4d74e-03bd-409e-918a-e4d08edab664 (a2c4d74e-03bd-409e-918a-e4d08edab664): created successfully Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e194d0-9073-4b16-907d-2f165d22441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (830c4246-1795-467f-8bca-aad301a8aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-e3f243d3-df8c-44ae-bd83-0f1858eef5e6-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68" returned: 0 in 0.806s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 1 in 1.490s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] <== create_volume: return (1591ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Downloaded image a40efe33-b065-4bf8-838d-65f004259abb ((None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}])) to volume 17fbd345-cba3-4855-85b0-144111547569 successfully. {{(pid=83513) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.image.image_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Temporary image a40efe33-b065-4bf8-838d-65f004259abb for user 046c95d2c337490b92453de8c4c8638a is deleted. {{(pid=83513) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.volume_utils [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Marking volume 17fbd345-cba3-4855-85b0-144111547569 as bootable. {{(pid=83513) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 13:37:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-a99962e5-074e-40c3-b923-07ed1830c5e5 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-e3f243d3-df8c-44ae-bd83-0f1858eef5e6-delete_volume" acquired by "delete_volume" :: waited 0.230s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Copying metadata from image a40efe33-b065-4bf8-838d-65f004259abb to 17fbd345-cba3-4855-85b0-144111547569. {{(pid=83513) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Creating volume glance metadata for volume 17fbd345-cba3-4855-85b0-144111547569 backed by image a40efe33-b065-4bf8-838d-65f004259abb with: {'image_id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7797f4a78f4be692a2265461110358b5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83513) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42c970c-4c29-4c83-a7c6-714c81745351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b52104-c4d4-4639-a796-514226b6ea68', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f92f58c-8ae0-4c2e-a102-2ef594a4d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:45 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Delete snapshot completed successfully. Sep 16 13:37:45 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume volume-17b52104-c4d4-4639-a796-514226b6ea68 (17b52104-c4d4-4639-a796-514226b6ea68): created successfully Sep 16 13:37:45 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f92f58c-8ae0-4c2e-a102-2ef594a4d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Flow 'volume_create_manager' (f9bab385-83e3-4d35-9399-2a541c0b58d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-c498f6ac-23dc-4a99-b8e1-0a58d196a8c3 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-a0b54547-9859-4b77-a00e-a78d2757c5d0-delete_snapshot" released by "delete_snapshot" :: held 11.575s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462c5c55-6778-4f69-8922-68a2a1cf7fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17fbd345-cba3-4855-85b0-144111547569', 'volume_size': 1, 'image_id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40efe33-b065-4bf8-838d-65f004259abb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7797f4a78f4be692a2265461110358b5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ca699aede3f248a7998a825043bd6387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '084b2a91a90549ad7816d2748e1d919df0f858602ea69a85d42d3538727ee53e8ec7bcb5b5274433f0ee3c6ff8edb4250126215c5b756b1fba32179eff4e44ec', 'id': 'a40efe33-b065-4bf8-838d-65f004259abb', 'created_at': datetime.datetime(2025, 9, 16, 11, 37, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 11, 37, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40efe33-b065-4bf8-838d-65f004259abb/file', 'properties': {}}, 'image_service': }' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0214507-94d9-4ff6-a5d7-6ace3790637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:37:46 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-73b879d1-8737-4dd4-bbcf-d750ac92d0ce tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created volume successfully. Sep 16 13:37:46 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Volume volume-17fbd345-cba3-4855-85b0-144111547569 (17fbd345-cba3-4855-85b0-144111547569): created successfully Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0214507-94d9-4ff6-a5d7-6ace3790637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Flow 'volume_create_manager' (9eb87cf8-a3f8-4aeb-aee3-179e106e952e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" acquired by "delete_volume" :: waited 0.056s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:46 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-07728472-fe33-4bf1-85bf-dc35cfccff6a tempest-VolumeImageDependencyTests-1111118778 None] Created volume successfully. Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[60417cc6-d0b7-4141-8f55-3cd362e1e8a1]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-0fa43746-988a-4163-8e5a-63de2013989d-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Acquiring lock "cinder-17fbd345-cba3-4855-85b0-144111547569-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "cinder-17fbd345-cba3-4855-85b0-144111547569-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:46 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-0fa43746-988a-4163-8e5a-63de2013989d-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.783s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-0fa43746-988a-4163-8e5a-63de2013989d" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:47 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Acquiring lock "cinder-quobyte-17fbd345-cba3-4855-85b0-144111547569" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" returned: 0 in 0.544s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-0fa43746-988a-4163-8e5a-63de2013989d" acquired by "delete_volume" :: waited 0.104s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "cinder-quobyte-17fbd345-cba3-4855-85b0-144111547569" acquired by "delete_volume" :: waited 0.107s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e3f243d3-df8c-44ae-bd83-0f1858eef5e6" released by "delete_volume" :: held 1.495s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa2dca8-1148-40e3-a0a0-75e760cfd1df]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[82de82f8-9109-4b02-8b1f-fc1ab76d5a09]: (4, 'raw') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:47 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:48 devstack quobyte-client[83541]: System call of process 101779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d" returned: 0 in 0.735s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:48 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Created reservations ['1604acb3-318e-4124-b2be-6552c5a58e3f', '158e931c-7dec-4260-ba2a-9a6a33e9b26b', 'f312ec02-ee10-48ea-8c0b-8dc520b73c33', '7437e9f1-d98e-47d6-b2a2-85d7cbbdaa81'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:48 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-0fa43746-988a-4163-8e5a-63de2013989d" returned: 0 in 0.398s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 0 in 1.139s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-0fa43746-988a-4163-8e5a-63de2013989d" released by "delete_volume" :: held 1.704s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 1 in 0.599s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569' failed. Not Retrying. {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17fbd345-cba3-4855-85b0-144111547569" returned: 0 in 0.155s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:49 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "cinder-quobyte-17fbd345-cba3-4855-85b0-144111547569" released by "delete_volume" :: held 2.307s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-e37e5fa4-4c0e-49ea-8a63-97890cef572f-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['756cf35c-d0f2-4216-aaa6-4dc86c2dddd4', 'b4901f77-0e97-4b93-9ba5-ae114f363d17', 'cc9d7fd9-186d-4f37-ad87-68c43b639946', '5356626b-13fa-4981-8509-73c8de0b2eed'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-e37e5fa4-4c0e-49ea-8a63-97890cef572f-delete_volume" acquired by "delete_volume" :: waited 0.232s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.558s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:50 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Deleted volume successfully. Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-e35b165f-8360-4cb4-af98-7922e682e8b5 tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-e3f243d3-df8c-44ae-bd83-0f1858eef5e6-delete_volume" released by "delete_volume" :: held 5.004s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:50 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:50 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-a2c4d74e-03bd-409e-918a-e4d08edab664-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Created reservations ['6d736ed9-3ca5-44c8-b94f-e46ee4c1be6b', '1101ad1b-9fbf-4a27-bebd-d9ab57df7f46', '03aa6c0b-8a88-4c3a-bcb1-7e0d3a4e54b8', '17304a02-1d62-4536-9533-db6d6380ea4f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" acquired by "delete_volume" :: waited 0.510s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.541s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0a984-c5c8-4a81-a15e-7b729792fa7e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:51 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-a2c4d74e-03bd-409e-918a-e4d08edab664-delete_volume" acquired by "delete_volume" :: waited 0.505s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:51 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9746de1e-f8b2-4934-a1de-9acac9e9de51 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-0fa43746-988a-4163-8e5a-63de2013989d-delete_volume" released by "delete_volume" :: held 4.911s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:52 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-a2c4d74e-03bd-409e-918a-e4d08edab664" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f" returned: 0 in 0.634s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-a2c4d74e-03bd-409e-918a-e4d08edab664" acquired by "delete_volume" :: waited 0.556s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8750ef-9d0f-4d2a-b77b-ac2d6b544c82]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e37e5fa4-4c0e-49ea-8a63-97890cef572f" returned: 0 in 0.629s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:52 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-quobyte-e37e5fa4-4c0e-49ea-8a63-97890cef572f" released by "delete_volume" :: held 1.605s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.679s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:53 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Deleted volume successfully. Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-0dccedb7-f0d1-424f-a235-bd357c47d696 tempest-VolumeImageDependencyTests-1111118778 None] Lock "cinder-17fbd345-cba3-4855-85b0-144111547569-delete_volume" released by "delete_volume" :: held 6.403s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:53 devstack quobyte-client[83541]: System call of process 101797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664" returned: 0 in 0.710s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a2c4d74e-03bd-409e-918a-e4d08edab664" returned: 0 in 0.187s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Created reservations ['b3dc018d-d5e4-4e75-a33e-37dccc34b785', '51be317a-3383-4a98-b91e-ac5fbb9847ec', 'e6402e80-d35b-43b6-a065-142baa8c0262', '28845142-6196-4b3f-a63c-95a72b1f5f7d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:53 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-a2c4d74e-03bd-409e-918a-e4d08edab664" released by "delete_volume" :: held 1.201s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['76924775-382f-4cbd-92f8-b9161f923f91', 'b1d4bc7b-0b59-4417-9cac-a42ea3f6af4b', 'c99adaaf-4cee-42fb-a7f9-cceff240e592', 'a18643f6-3218-42b3-8553-f7e804965435'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.400s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:54 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:54 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Deleted volume successfully. Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-17b52104-c4d4-4639-a796-514226b6ea68-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.576s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:55 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-17b52104-c4d4-4639-a796-514226b6ea68-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b482e51a-de4c-4f47-be0e-4f8181f37c7a tempest-SnapshotDependencyTests-1633327346 None] Lock "cinder-e37e5fa4-4c0e-49ea-8a63-97890cef572f-delete_volume" released by "delete_volume" :: held 4.554s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-6771824e-4de0-4987-b7d9-00ae9e306f85 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-a2c4d74e-03bd-409e-918a-e4d08edab664-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:55 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-17b52104-c4d4-4639-a796-514226b6ea68" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-17b52104-c4d4-4639-a796-514226b6ea68" acquired by "delete_volume" :: waited 0.017s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[2938bc03-27df-4690-bb4e-70d43a400b67]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:55 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68" returned: 0 in 0.569s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:56 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-17b52104-c4d4-4639-a796-514226b6ea68" returned: 0 in 0.163s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:56 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-17b52104-c4d4-4639-a796-514226b6ea68" released by "delete_volume" :: held 0.952s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:56 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['dad6ce14-aae7-4b37-87f6-f22a3421fbf4', 'dd7c2d38-70f8-4f97-9d25-a875f476e81f', '3d5caafc-7cfd-43ae-84d1-cd05d2af087f', 'f0a9672f-166d-4019-846d-eff123c7d227'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.128s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:37:57 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:37:57 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-d4eddc87-ddb9-41a7-ba4e-7b56aa150039 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-17b52104-c4d4-4639-a796-514226b6ea68-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-a94b4439-1ade-410d-be74-321702291b6a-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-a94b4439-1ade-410d-be74-321702291b6a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:58 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-a94b4439-1ade-410d-be74-321702291b6a" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-a94b4439-1ade-410d-be74-321702291b6a" acquired by "delete_volume" :: waited 0.014s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[6311bf64-d993-4066-be27-ad16e4f4c3da]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:37:58 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a" returned: 0 in 0.464s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-a94b4439-1ade-410d-be74-321702291b6a" returned: 0 in 0.112s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-a94b4439-1ade-410d-be74-321702291b6a" released by "delete_volume" :: held 0.765s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['11eb82ee-6c95-4439-bb04-d4ec690a6fe1', 'b071b1e8-6caa-4f49-ad50-674fb884eecf', '92030639-04d3-4034-9a36-a60a81b61354', '114f4008-237c-46cd-8511-e61212c3dbae'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:37:59 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:00 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:38:00 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:38:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-be2ec4d1-c3f9-4902-ba87-e3ac25a546f3 tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-a94b4439-1ade-410d-be74-321702291b6a-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-437a88f2-5d31-4966-8343-0409ff6c23d6-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-437a88f2-5d31-4966-8343-0409ff6c23d6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:00 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:00 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-437a88f2-5d31-4966-8343-0409ff6c23d6" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-437a88f2-5d31-4966-8343-0409ff6c23d6" acquired by "delete_volume" :: waited 0.025s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6bd345-01e5-4bb2-a8d4-fa063fac28d9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6" returned: 0 in 0.526s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-437a88f2-5d31-4966-8343-0409ff6c23d6" returned: 0 in 0.146s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:01 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-437a88f2-5d31-4966-8343-0409ff6c23d6" released by "delete_volume" :: held 0.891s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['71121516-3409-451d-a2f2-22997d2541c2', '5b1e3ac2-67b4-458f-9bc8-1d92c0e4c912', '87f0b173-2f30-437f-8508-9b7bf2f7c4f9', 'b6a06a57-766a-4742-9eb2-f515a463b73f'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:02 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:38:02 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-742bd130-4d6b-4462-81fd-93d2d221446a tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-437a88f2-5d31-4966-8343-0409ff6c23d6-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-9c45c6fe-fec0-4073-8db0-0284ca36bb51-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-9c45c6fe-fec0-4073-8db0-0284ca36bb51-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:03 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "cinder-quobyte-9c45c6fe-fec0-4073-8db0-0284ca36bb51" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-9c45c6fe-fec0-4073-8db0-0284ca36bb51" acquired by "delete_volume" :: waited 0.020s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d2059a-d293-4c0a-9547-fc3e1f817cc9]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:03 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51" returned: 0 in 0.554s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-9c45c6fe-fec0-4073-8db0-0284ca36bb51" returned: 0 in 0.134s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-quobyte-9c45c6fe-fec0-4073-8db0-0284ca36bb51" released by "delete_volume" :: held 0.875s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Created reservations ['eff193c5-6b94-4e4d-b7b5-4b730fe00291', '4290a514-18d0-4465-9148-d9e4bf42786f', '98329b98-8522-45e7-acc0-62bdbde402cf', 'd67b3033-fe16-473d-882f-65fbc83a5431'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.097s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:04 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:38:05 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Deleted volume successfully. Sep 16 13:38:05 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-939b1be0-3a91-4824-b1b9-ec3b21c00fcc tempest-CreateVolumesFromSourceVolumeTest-1758848612 None] Lock "cinder-9c45c6fe-fec0-4073-8db0-0284ca36bb51-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:10 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Flow 'volume_create_manager' (7a25742d-fdaf-4e63-a77d-3cc99b54793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dc08df-10da-442f-9509-1ad389d55671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dc08df-10da-442f-9509-1ad389d55671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3232665-f851-4cea-b2cd-10cc11ca80f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17210392575d47a4acaea77e1b516763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:38:10Z,use_quota=True,user_id='72d84769edac4d21aded52dbc5ec83f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31c226a-7dfe-4b72-8b4e-46a5d420c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31c226a-7dfe-4b72-8b4e-46a5d420c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a445775-c2ad-48d8-8f4c-04372525e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a445775-c2ad-48d8-8f4c-04372525e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3232665-f851-4cea-b2cd-10cc11ca80f4', 'volume_name': 'volume-e3232665-f851-4cea-b2cd-10cc11ca80f4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e8a4d-91cb-48b6-86f9-24a7f7a82c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e8a4d-91cb-48b6-86f9-24a7f7a82c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5515ebe2-ec5b-4b6a-8544-ea18c1f05ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:10 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Volume e3232665-f851-4cea-b2cd-10cc11ca80f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3232665-f851-4cea-b2cd-10cc11ca80f4', 'volume_size': 1} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3232665-f851-4cea-b2cd-10cc11ca80f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17210392575d47a4acaea77e1b516763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:38:10Z,use_quota=True,user_id='72d84769edac4d21aded52dbc5ec83f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Creating volume e3232665-f851-4cea-b2cd-10cc11ca80f4 {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:38:10 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:10 devstack quobyte-client[83541]: System call of process 101835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:38:10 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=170, name=volume-e3232665-f851-4cea-b2cd-10cc11ca80f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 1073741824" returned: 0 in 0.510s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:10 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4" returned: 0 in 0.105s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5515ebe2-ec5b-4b6a-8544-ea18c1f05ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3232665-f851-4cea-b2cd-10cc11ca80f4', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9dea81-6f8f-4ba1-b458-5261faef8025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:11 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Volume volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 (e3232665-f851-4cea-b2cd-10cc11ca80f4): created successfully Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9dea81-6f8f-4ba1-b458-5261faef8025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:11 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Flow 'volume_create_manager' (7a25742d-fdaf-4e63-a77d-3cc99b54793a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:38:11 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-de104971-665b-4eb9-bd10-47961ef15b4a tempest-CinderUnicodeTest-2041020559 None] Created volume successfully. Sep 16 13:38:12 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.flows.manager.create_volume [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83513) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Flow 'volume_create_manager' (53706560-9050-409d-b6fc-bc218b1f6e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e63cf8-5809-41b4-a507-ecff5874d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e63cf8-5809-41b4-a507-ecff5874d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:38:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-786948510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6bc7f5-e566-446d-b8f1-48f35518f14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17210392575d47a4acaea77e1b516763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:38:13Z,use_quota=True,user_id='72d84769edac4d21aded52dbc5ec83f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07334ca1-3385-417d-bce2-087e838300b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07334ca1-3385-417d-bce2-087e838300b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b534ece1-70ab-4701-91e4-34a898265b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b534ece1-70ab-4701-91e4-34a898265b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6bc7f5-e566-446d-b8f1-48f35518f14b', 'volume_name': 'volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f0be84-1ddf-4550-be06-2db74e10ad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f0be84-1ddf-4550-be06-2db74e10ad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54094cb3-d5e4-40fc-850e-52029b0e9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:12 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Volume 6a6bc7f5-e566-446d-b8f1-48f35518f14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b', 'volume_size': 1} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T11:38:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-786948510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6bc7f5-e566-446d-b8f1-48f35518f14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17210392575d47a4acaea77e1b516763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T11:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T11:38:13Z,use_quota=True,user_id='72d84769edac4d21aded52dbc5ec83f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dbab5c-8f62-4b12-b773-7396f1d2c357),volume_type_id=68dbab5c-8f62-4b12-b773-7396f1d2c357)}" {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Creating volume 6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:12 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Selected 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 as target Quobyte volume. {{(pid=83513) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:664}} Sep 16 13:38:13 devstack cinder-volume[83513]: INFO cinder.volume.drivers.remotefs [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] casted to 10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0 Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b 1073741824 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:13 devstack quobyte-client[83541]: System call of process 101839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:38:13 devstack quobyte-client[83541]: System call of process 101839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:38:13 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=171, name=volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b 1073741824" returned: 0 in 0.457s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b" returned: 0 in 0.161s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] <== create_volume: return (696ms) {'provider_location': '10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'} {{(pid=83513) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54094cb3-d5e4-40fc-850e-52029b0e9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b', 'volume_size': 1}' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc98a14-6baf-44a4-a72a-3ccf457d7216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 13:38:13 devstack cinder-volume[83513]: INFO cinder.volume.flows.manager.create_volume [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Volume volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b (6a6bc7f5-e566-446d-b8f1-48f35518f14b): created successfully Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc98a14-6baf-44a4-a72a-3ccf457d7216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83513) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 13:38:13 devstack cinder-volume[83513]: DEBUG cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Flow 'volume_create_manager' (53706560-9050-409d-b6fc-bc218b1f6e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83513) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 13:38:13 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-073095a9-ff12-4a98-9235-83fc45b8385e tempest-CinderUnicodeTest-2041020559 None] Created volume successfully. Sep 16 13:38:15 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Creating offline snapshot e1e5e77a-86dd-4b54-82a9-132138fef015 of volume 6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[84911d44-2bf5-48b1-8a2f-4da402005cf0]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b" returned: 0 in 0.419s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 1G {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:15 devstack quobyte-client[83541]: The server volume:6e8c7697-8e04-496a-b7b4-368487b85e35@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e8c7697-8e04-496a-b7b4-368487b85e35, inode=172, name=volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.224), requestorAccessMask=0 Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 1G" returned: 0 in 0.250s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:15 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "qemu-img rebase -u -b volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b -F qcow2 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.144s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.081s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Setting permissions: /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b -> 1000:1000 {{(pid=83513) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.102s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.info" returned: 0 in 0.093s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] File path /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.info is being set with permissions: 660 {{(pid=83513) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.info {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.info" returned: 0 in 0.089s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:16 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.490s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:16 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-fb542c67-403f-4ac7-bd85-0b4abdf1f9ee tempest-CinderUnicodeTest-2041020559 None] Create snapshot completed successfully Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-e1e5e77a-86dd-4b54-82a9-132138fef015-delete_snapshot" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-e1e5e77a-86dd-4b54-82a9-132138fef015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:17 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" by "delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-quobyte-e1e5e77a-86dd-4b54-82a9-132138fef015" by "_delete_snapshot" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-e1e5e77a-86dd-4b54-82a9-132138fef015" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Deleting offline snapshot e1e5e77a-86dd-4b54-82a9-132138fef015 of volume 6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] snapshot_file for this snap is: volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8a002-92e8-4923-a99f-72c55a486ce5]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.396s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.remotefs [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83513) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd6094-21ab-40f7-9ddb-15bfbe8a6961]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:17 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b" returned: 0 in 0.381s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:18 devstack quobyte-client[83541]: System call of process 101863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.223s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b.e1e5e77a-86dd-4b54-82a9-132138fef015" returned: 0 in 0.088s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-e1e5e77a-86dd-4b54-82a9-132138fef015" released by "_delete_snapshot" :: held 1.399s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:18 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" released by "delete_snapshot" :: held 1.422s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Created reservations ['1da20577-ae36-47df-b516-3a5e4dad5351', '6cf3830d-42af-4d17-a524-770a32271188', 'a761ea17-aa00-42fe-adb3-90e8e4c6a399', 'd8479dbd-87ea-4055-a137-c1f71825e23b'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:38:19 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Delete snapshot completed successfully. Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-9970067d-8bb5-4276-bf35-07297e98c9cb tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-e1e5e77a-86dd-4b54-82a9-132138fef015-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-6a6bc7f5-e566-446d-b8f1-48f35518f14b-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-6a6bc7f5-e566-446d-b8f1-48f35518f14b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:19 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" acquired by "delete_volume" :: waited 0.016s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe0f7a2-5b67-4dff-9f31-a0d9e1ad6b9e]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:19 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b" returned: 0 in 0.405s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-6a6bc7f5-e566-446d-b8f1-48f35518f14b" returned: 0 in 0.098s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-6a6bc7f5-e566-446d-b8f1-48f35518f14b" released by "delete_volume" :: held 0.674s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Created reservations ['780a1234-91dc-4d32-9d37-af51fb38954d', '165cf32a-a457-4948-876e-7ba59e95b088', 'd5af4c3b-57aa-4678-8ea8-fbf746d9b5c1', '74a5b1e5-2038-40bc-8891-4233f745421d'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:20 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:21 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.173s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:21 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:38:21 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Deleted volume successfully. Sep 16 13:38:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-f6ad1732-0b38-40be-805d-7e65559a63da tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-6a6bc7f5-e566-446d-b8f1-48f35518f14b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-e3232665-f851-4cea-b2cd-10cc11ca80f4-delete_volume" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:21 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-e3232665-f851-4cea-b2cd-10cc11ca80f4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:22 devstack cinder-volume[83513]: WARNING cinder.volume.volume_utils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Volume driver (QuobyteDriver 1.1.14) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "cinder-quobyte-e3232665-f851-4cea-b2cd-10cc11ca80f4" by "delete_volume" {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-e3232665-f851-4cea-b2cd-10cc11ca80f4" acquired by "delete_volume" :: waited 0.011s {{(pid=83513) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee9289-be8b-4066-adb4-3425eea5f9bf]: (4, 'qcow2') {{(pid=84812) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4" returned: 0 in 0.437s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] CMD "rm -f /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558/volume-e3232665-f851-4cea-b2cd-10cc11ca80f4" returned: 0 in 0.106s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:22 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-quobyte-e3232665-f851-4cea-b2cd-10cc11ca80f4" released by "delete_volume" :: held 0.686s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG cinder.quota [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Created reservations ['94051ebd-162a-441e-bb1b-4cded1ed04ce', '8d79254f-a945-4e0d-8b2f-9117bf71a4bb', '5dc2d121-8ad7-4d93-9ecd-fd5c9a1a0437', 'a1c8643c-641a-446e-8e1a-2796613164a9'] {{(pid=83513) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.121s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 13:38:23 devstack cinder-volume[83513]: INFO cinder.volume.manager [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Deleted volume successfully. Sep 16 13:38:23 devstack cinder-volume[83513]: DEBUG cinder.coordination [None req-b6288ea3-9099-4096-9c1b-936049c2fc7e tempest-CinderUnicodeTest-2041020559 None] Lock "cinder-e3232665-f851-4cea-b2cd-10cc11ca80f4-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=83513) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 13:38:33 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:SELECT=89,cinder:UPDATE=125,cinder:DELETE=13,cinder:INSERT=24 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:38:33 devstack cinder-volume[83513]: DEBUG dbcounter [-] [83513] Writing DB stats cinder:UPDATE=115,cinder:SELECT=67,cinder:DELETE=9,cinder:INSERT=36 {{(pid=83513) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_service.periodic_task [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83513) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0': None} {{(pid=83513) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:613}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG cinder.volume.drivers.quobyte [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Available shares ['10.10.41.181/cinder-vol-ff97909b-28b6-4c99-b209-77cd921dafa0'] {{(pid=83513) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:643}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.lockutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83513) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558 {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG oslo_concurrency.processutils [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/895041c2775af96b330b2d2452120558" returned: 0 in 0.131s {{(pid=83513) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 13:38:41 devstack cinder-volume[83513]: DEBUG cinder.manager [None req-d573708d-d318-400c-9125-2e3aabde4444 None None] Notifying Schedulers of capabilities ... {{(pid=83513) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}